You are severely underestimating Google's infrastructure if you think the latency to your nearest datacenter is going to be 500 ms.
The problem is you need the latency for the nearest Google DC with graphic cards in servers which might not be your nearest Google DC at all. And Google probably fucked up other things too, considering the amount of fail in thsi product.