[k888sss]

Unfortunately, client code is not upgradable, and I have to solve this issue from server side only.

[neonlex]

I don’t understand your answer, that’s basically what wmf described. Put a proxy or load balancer in front of your service.

[k888sss]

Thanks. I can't upgrade clients to add reconnect functionality, and I can only work on the server side to solve the scaling issue. I think I should refactor my service as you mentioned by separating dedicated connection-managing servers and stateless worker servers such that I can scale workers.