[dinosaurdynasty]

That's likely only the marginal cost of training this model, and doesn't include a lot of other costs, like the datacenters and GPUs themselves which they already had and also the staff.

If they aren't lying because they have hardware they're not supposed to have, which is also a possibility.

[whimsicalism]

these claims are getting more wrong every time i see them, weird game of telephone going around tech circles.

the cost absolutely includes the cost of GPUs and data centers, they quoted a standard price for renting h800 which has all of this built in. but yes, as very explicitly noted in the paper, it does not include cost of test iterations