[MrGuts]

Have you taken a look at Ollama + Open-WebUI? This combo ticks off some items on your list, especially if you use the Dockerized versions.