They have to be competitive. TPUs are wildly ahead of the pack. And even they aren't particularly competitive. 12 years of ecosystem development by the most advanced AI ecosystem company on the planet and your (ex-Google!) researchers are still going to pelt you with tomatoes if you tell them you are swapping out their H100 cluster with TPUs. JAX remains niche (not saying bad) and extremely hard to use efficiently without the help of Google (no CUDA for going off the beaten path).I suspect the closed nature of the ecosystem will preclude them from winning as much as they could.
No comments yet.