[ronaldoCR]

Doesn't the sheer cost of training create a moat on its own?

[hiddencost]

It's cheap to distill models, and trivial to scrape existing models. Anything anyone does rapidly gets replicated for 1/500th the price.

[echelon]

Yes, but so far we've seen universities, venture-backed open source outfits, and massive collections of hobbyists train all sorts of large models.