Ask HN: Self-hosting LLMs, is it worth the setup?

[sb13]

With the advent of DeepSeek, I was thinking if I should consider self-hosting open source LLMs vs using OpenAI APIs. Who here has done this already? And what are your main reasons, privacy or cost?

[8thcross]

people have been doing this for a while now? cost is one factor obviously, but privacy, security, and offline use comes to mind.

[sb13]

I was thinking more about them in my cloud environment. Was it easy to setup and maintain for you?