> the largest Cloud TPU Pod configuration tested (256 chips) delivers a 200X speedup over an individual V100 GPU
So a Cloud TPU chip is slower than a V100 chip? Seems like that's the answer.
So a Cloud TPU chip is slower than a V100 chip? Seems like that's the answer.
I’m also curious what the is the performance of the network interconnects in the TPU pod. I couldn’t find it documented, though I didn’t look super hard.
[1] https://github.com/uber/horovod/blob/master/docs/benchmarks....