top | item 44570863

(no title)

code51 | 7 months ago

Anthropic is actually a good point to focus on since Claude is very good proof that it's not about the scaling. We are not quite there yet but we are "programming" through how we shape and filter the input data for training it seems. With time, we'll understand the methods to better represent.

Current situation doesn't sound too good for "scaling hypothesis" itself.

discuss

order

yourapostasy|7 months ago

> Current situation doesn't sound too good for "scaling hypothesis" itself.

But the “scaling hypothesis” is the easiest, fastest story to raise money. So it will be leveraged until conclusively broken by the next advancement.