Sam Altman estimated that the cost to train GPT-4 was about $100 million. Not only is this not tremendously expensive, it's pocket change for thousand of corporations around the world.
But even if what you said was true, this technology is progressing faster than we can write news stories about it. OpenAI itself is only a few years old, and you can already run a GPT-3-class model on your laptop. Any prognostication you make about cost will be valid for approximately a month.
And, I'm sorry I can't help myself, what the heck do you mean by colocated? Exactly what things need to be colocated?