Hacker News Reader

In the future AI will be commoditized. You'll be able to buy an inference server for your home in the form factor like a wi-fi router now. They will be cheap and there will be a huge selection of different models, both open-source and proprietary. You'll be able to download a model with a click of a button. (Or just torrent them.)

View on HN

That can be done with today's desktops already, if you beef up the specs slightly.

The smaller models are becoming even more capable now. Add that with a suite of tools and integrations and you can do most of what you do online within the infra at home.

Cheap Chinese single-board computers made specifically for inference is the missing puzzle piece. (No, GPU's and especially Nvidia is not that.)

Also the current crop of AI agents are just utter crap. But that's a skill issue of the people coding them, expect actual advances here soon.

Aren't DGX Spark or Framework Desktop cheap enough?

Not really. Eventually we'll get something with the price and availability of a home appliance. (Wi-fi router tier.)

Reply on news.ycombinator.com