I don't think it will be the moment nvidia decide there's more money to be made in selling hardware for local-first inference. They'll do the training themselves and give the models away for free, like the toy in a box of cornflakes.

I'm sure cloud models will always have a slight edge but most tasks, most of the time, won't need that few extra percentage points of performance.

>> out of reach financially and technically for most people

Yes and no. I bought most of the hardware before the rampocalypse. It is just an AM4 chip on a nothing motherboard. Even today, 16GB 5060s are maybe 500 each. 64GB of DDR4 is another 500$. Add a power supply and pci risers and the basic parts could be purchased today for around 3000$... call it 4000$ all-in including my labor to get everything connected and talking to each other.

4000$ is money but is also almost nothing in the world of commercial IT purchases.

The article is about the Swedish Government, hopefully it wouldn't be out of reach for them.