top | item 43901752

(no title)

nirv | 10 months ago

Not sure about the moat, it's mostly a SvelteKit web app with extra utils after all. But it has a rather unique combination of advanced features (RAG integrations, workspaces[1], pipelines[2], code execution[3], MCP integration[4], etc.) and a user-friendly "production grade" interface. I've built a dependency for OWUI using many of these advanced features, and now I'm trying to figure out where to migrate with no obvious alternatives.

My only gripe with the project was the (exorbitant) size of the docker containers, especially for cases where you need a tool with no local models, just a gateway to third-party APIs. Now another and more serious one has been added.

[1] https://docs.openwebui.com/features/workspace/

[2] https://docs.openwebui.com/pipelines/

[3] https://docs.openwebui.com/features/code-execution/

[4] https://docs.openwebui.com/openapi-servers/mcp

discuss

order

never_inline|9 months ago

It's RAG never worked for me tbh. I thought it was simply because I didn't have Gpu.

nirv|9 months ago

I tried it once, and I couldn't run RAG without the GPU either (only using external APIs). Considering that they pull all the heavy deps even with the local compute flags disabled, I assume this is just a poorly supported case. Which is really unfortunate.