The article talks about this explicitly though. Reasonably good models are running on raspberry Pis now.
Maybe this is why Sam Altman talked about "the end of the large LLMs is here"? He understands anything bigger than ChatGPT-4 isn't viable to run at scale and be profitable?
At what limit does it stop getting better?