top | item 46741313

(no title)

bitkin_dev | 1 month ago

Great breakdown, thanks for writing this up.

One thing I’m still unclear on: in real production workloads, what ended up being the main bottleneck first — memory bandwidth, KV cache management, or scheduler overhead?

Curious how much of this showed up only under sustained load versus benchmarks.

discuss

order

No comments yet.