Why can't we develop different architectures?
Cutting energy costs by an order of magnitude could be enough motivation, but you'll still need to demonstrate competitive model performance.
It's not as if we said wow, all you need is attention, and then Nvidia built some GPUs for it.