What is the lifetime value of an individual pretraining run, and what is the cost to do it? Whether it is a net positive seems to still be an open question.
Actually there is a chart of answers to this question, because the frontier providers have been delivering new models for some time. The answer is that so far they have been net positive.
vessenes|17 days ago