[encomiast]

I’m not sure what ‘successfully’ means in this context. If it means training a model that is noticeably better than previous models, it’s not hard to see how that is challenging.

[MikeTheGreat]

Ah. Thanks for posting - this makes a lot of sense.

I can totally see how they're able to pre-train models no problem, but are having trouble with the "noticeably better" part.

Thanks!

[mudkipdev]

OpenAI allegedly has not completed a successful pretraining run since 4o