[allenz]

That’s only for the final model. To find it, they’d need to run 1,000 experiments, trying many high-level approaches, many architectures for each component, hyperparameter search, and multiple seeds. Large machine learning projects need $10M in capital.

[jeffbee]

I bet it's still a lot less than they spent training AlphaStar.