It's hard to predict the future. For example this was a popular article not that long ago - https://www.semianalysis.com/p/google-we-have-no-moat-and-ne...
For inference, the difference between expensive data center hardware and homemade GPUs largely comes down the distinction of RAM. Which is a limitation actively worked around (unfortunately all the well-funded orgs are not that interested in this)