Google most certainly uses TPUs for training.