How is this different from - say - synthetic neurons that IBM is working on, or what nvidia is building?
1. It works already (IE it's already in use)
2. It works really well (or else they wouldn't be using it so broadly)
3. Considering how long this was said to be in development, it also likely means they are working on the next big improvement before these guys have even gotten the current one working.
TPUs are custom ASICs that speed up math on tensors i.e. high-dimensional matrices. Tensors feature prominently in artificial neural networks, especially the deep learning architectures. While GPUs help accelerate these operations, they are optimized first and foremost for video rendering/gaming applications -- compute-specific features are mostly tacked on. TPUs are optimized solely for doing ML-related computations.