top | item 46254561

(no title)

eep_social | 2 months ago

in high scale stateless app services this approach is typically used to lower tail latency. two identical service instances will be sent the same request and whichever one returns faster “wins” which protects you from a bad instance or even one which happens to be heavily loaded.

discuss

order

noitpmeder|2 months ago

I'm not sure I follow. In this instance we're talking about multiple backend matching engines... Correct? By definition they must be kept in sync, or at least have total omnipotent knowledge about the state of all other backend book states.

lanstin|2 months ago

And the tail latencies are wildly improved with each addition dup. Has to be idempotent of course.