top | item 43126336 (no title) sakex | 1 year ago > They won’t notice those extra 10 milliseconds you savedDepends what you're doing. In my case I'm saving microseconds on the step time of an LLM used by hundreds of millions of people. discuss order hn newest ryankrage77|1 year ago Beauty of scale. Saving ten milliseconds a hundred times is just a second. But do it a billion times and you've shaved off ~4 months. nottorp|1 year ago If you work at Google or whatever else is popular or monopolistic this week.In most real jobs those ten milliseconds will add up to what, 5 seconds to a minute? load replies (1)
ryankrage77|1 year ago Beauty of scale. Saving ten milliseconds a hundred times is just a second. But do it a billion times and you've shaved off ~4 months. nottorp|1 year ago If you work at Google or whatever else is popular or monopolistic this week.In most real jobs those ten milliseconds will add up to what, 5 seconds to a minute? load replies (1)
nottorp|1 year ago If you work at Google or whatever else is popular or monopolistic this week.In most real jobs those ten milliseconds will add up to what, 5 seconds to a minute? load replies (1)
ryankrage77|1 year ago
nottorp|1 year ago
In most real jobs those ten milliseconds will add up to what, 5 seconds to a minute?