You might want to take a look at SillyTavern. Supports multiple backends, accept...

accrual · 2025-04-14T23:58:23 1744675103

Also Open WebUI. It's a very nice piece of software that provides a ChatGPT/Claude-like interface, but with lots of extra features.

https://docs.openwebui.com/

dostick · 2025-04-14T22:24:43 1744669483

I keep hearing about it, but never got to check out, the name suggests that it may be waste of time. Maybe it’s a fantastic project but name lets it down?

frainfreeze · 2025-04-14T23:22:52 1744672972

You are on Hacker News, typing on Apple, listening to Daft Punk, reading an article about Steven, the AI butler hosted on Val Town, comment chain you're replying to talks about using self hosted models (probably llama) and Raspberry Pi, yet SillyTavern is the name that trips you up?

theshrike79 · 2025-04-16T09:29:32 1744795772

SillyTavern started up as a roleplaying model

As in "you meet a person at a tavern" and then you start chatting.

People provide different personalities to the project, sometimes with avatars and I think some can even change avatars based on their "mood".

fallinditch · 2025-04-14T23:22:55 1744672975

Having multiple backends can be a good approach, with various LLMs for different specialized tasks. I haven't tried it yet but WilmerAI is an option for routing your inputs to the appropriate LLM, works well with SillyTavern.