top | item 38665230

(no title)

jwuphysics | 2 years ago

I would be surprised if this is the case. Neural scaling laws are well known and are used by all big industry players to extrapolate experiments.

discuss

order

dmarchand90|2 years ago

Are they really "laws" my impression is its all just a bunch of empirical trends.

We cannot know truly how these parameters interact at large scale and also how they interact with each other.

Is it really the case that openai has data that Google doesn't?