top | item 41301583

(no title)

penthi | 1 year ago

Very cool. Why is the ai so fast? (Impressive)

discuss

order

ppsreejith|1 year ago

We've done a bunch of work to strip down the context and minimise the output tokens (which tends to be 100x as slow as input tokens). GPT-4o is pretty fast too :)

penthi|1 year ago

Thanks for the explanation. Can't wait to see the code when you open it up!