> G/A can't be used for large scale training, nobody is going to give their data to them. Major trust issues there.
And yet, that's what a lot of the big AI startups are doing. Granted, it's not what everyday business are doing (yet). But TPUs offer pretty impressive perf/cost ratio, so I'd be surprised if it's actually "nobody".