top | item 43126336

(no title)

sakex | 1 year ago

> They won’t notice those extra 10 milliseconds you saved

Depends what you're doing. In my case I'm saving microseconds on the step time of an LLM used by hundreds of millions of people.

discuss

order

ryankrage77|1 year ago

Beauty of scale. Saving ten milliseconds a hundred times is just a second. But do it a billion times and you've shaved off ~4 months.

nottorp|1 year ago

If you work at Google or whatever else is popular or monopolistic this week.

In most real jobs those ten milliseconds will add up to what, 5 seconds to a minute?