(no title)
Forgotthepass8 | 2 years ago
China probably doesn't even need them.
The reason we need so many in the West is because of the nature of capitalistic competition. Datacenters are full of GPUs next to each other (or even the same one just time divided) serving companies who are trying to beat the other out and gain customers
If one put even a fraction of all the compute used to make the current landscape into one foundational model (which they don't have to bother to build safety for nor pay alignment tax on) it would probably make gpt4 look like gpt2.
Not to mention they don't have to give the average person access to anything, they can invoke their MaoAI only for governmental purposes and just the rest a simple 6B model or something.
unknown|2 years ago
[deleted]