Pardon my ignorance, but who else besides Google has TPUs? Are they commercially available somewhere? What’s their main application right now outside of Google?
You can rent them on cloud + they sell directly to Anthropic. Its pretty well known that Anthropic is a heavy user of TPU's (along with Trainium & GPU's)
Google is selling TPUs to enterprise clients for on prem deployments. We’ve evaluated them but decided to stick with Nvidia, at least for one more generation. We’re a relatively large user of GCP.