top | item 41412627

(no title)

llmfan | 1 year ago

I mean, consistent mediocre releases is exactly what we have gotten out of OpenAI.

But we know they started training Orion in ~May. We know it takes months to train a frontier model. Lack of release isn't promising or worrying, it's just what one should expect. What is promising is the leaks about the high-quality synthetic data that Orion is training on. And the fact that OpenAI seems to be ahead of all the other labs which are only just now beginning training runs on next-gen models. OpenAI seems to have a lead on compute and on algorithmic innovation. A promising combination if there ever was one.

discuss

order

No comments yet.