[theLiminator]

I'd take any paper like this with a grain of salt. I imagine what holds true for models in time period X could drastically be different just given a little more time.

Doesn't mean it's not worth studying this kind of stuff, but this conclusion is already so "old" that it's hard to say it's valid anymore with the latest batch of models.

[nielstron]

This is life of an LLM researcher. We literally ran the last experiments only a month ago on what were the latest models back then...