(no title)
querez
|
1 month ago
I assume TPU TCO is significantly cheaper than GPU TCO. At the same time, I also assume that market demand for GPUs is higher than TPUs (external tooling is just more suited to GPU -- e.g. I'm not sure what the Pytorch-on-TPU story is these days, but I'd be astounded if it's on par with their GPU support). So moving all your internal teams to TPUs means that all the GPUs can be allocated to GCP.
YetAnotherNick|1 month ago
Again I am talking about LLM training/inference which if I were to guess is more than half of the workload currently for which the switching cost is close to 0.