top | item 42825065

(no title)

thethethethe | 1 year ago

IMO the you cannot fail by investing in compute. If it turns out you only need 1/1000th of the compute to train and or run your models, great! Now you can spend that compute on inference that solves actual problems humans have.

o3 $4k compute spend per task made it pretty clear that once we reach AGI inference is going to be the majority of spend. We'll spend compute getting AI to cure cancer or improve itself rather than just training at chatbot that helps students cheat on their exams. The more compute you have, the more problems you can solve faster, the bigger your advantage, especially if/when recursive self improvement kicks off, efficiency improvements only widen this gap

discuss

order

No comments yet.