Hopefully trained and running on zero emissions energy itself ?
Just looking up online, it seems 64% of the energy in Google datacenters is from clean sources, which is actually much better than I expected. Source: https://sustainability.google/progress/energy/
Should we not train GPT until Microsoft's data centers are all with zero emissions?
Yes.That is honestly what we should do. We are absolutely fucking this planet over and every other living creature is being pushed into major suffering. So yes we should have everything running on zero emissions, renewables / nuclear, yes.