> likely not possible to own the hardware outright

Why not? The majority of these models are running on fairly ubiquitous datacenter GPUs. They're being trained on highly available hardware. You're right that there's a compute barrier, but you get around that by throwing money at the problem. If someone was sufficiently motivated, they could probably dethrone OpenAI in 2 months with enough funding.