TPUs are good hardware, but TPUs are not available outside of GCP. There's not as much of an incentive for other companies to build software around TPUs like there is with CUDA. The same is likely true of chips like Cerebras' wafer scale accelerators as well.
Nvidia's won a stable lead on their competition that's probably not going to disappear for the next 2-5 years and could compound over that time.