Ask HN: How to scale long-lived connections with Kubernetes?

[k888sss]

My application serves users via long lived TCP connections and users are quite volatile. They come and go without any obvious patterns. And my current approach of scaling based on CPU/memory usage are too damn barbaric. I should not break active connections, but I also need to control the cost. On top my head, I can think of writing a custom middleware to manage connections and pods. Are there any ready-to-use solutions or approaches to tackle similar problems? Thanks

[wmf]

This kind of issue comes up in game development where I think the standard answer is a tier of proxies that can hold open the connection to the clients while reconnecting to different backends.

[k888sss]

Unfortunately, client code is not upgradable, and I have to solve this issue from server side only.

[thesandlord]

I know Agones[0] tackles this problem for game servers on Kubernetes. It could probably be used for this use case also, but it might also be overkill.

[0] https://github.com/GoogleCloudPlatform/agones

[k888sss]

Thanks a lot. This looks so promising. I am reading the docs :)