You're assuming costs remain high.
Pretty much every technology in history is available at several orders of magnitude lower cost than the first few years of it being invented.
AKA eventually everything runs on a potato.
Pretty much every technology in history is available at several orders of magnitude lower cost than the first few years of it being invented.
AKA eventually everything runs on a potato.
If we're talking web servers, sure. Video games? For the most part. Numerical high performance computing? ehhhhhhhhh i'm not sure history bears that out
Any numerical high performance computing from 1995 will run on a 100$ android phone.
https://en.wikipedia.org/wiki/Cray_T3E
And if this was the fastest, the average ones were significantly smaller.
What you're missing is that the things you mentioned sometimes took months to run in the fastest computers thirty years ago, but you are mentally expecting them to work quicker now.
Anyway, interesting talk, thanks. Have a good one.
Not today's raspberry pi, but the equivalent of it absolutely. I don't work in it, but have a number of friends who are involved in LLM development - the "breakthrough" optimizations are obvious work in hindsight. We are still in the very early innings of optimizing both hardware and software techniques. The recent market imbalance has blurred the idea that hardware simultaneously gets both cheaper and much better, but no one serious expects that to stop on a longer timeline.
Going beyond the "my watch has more computation power than NASA at the moon landing" - speech-to-text used to be unreliable tech that needed datacenters backing it as recently as the early iphone, and now runs in near-realtime on smartphones that cost about the same. A ~$50 processor running in my closet does realtime person/vehicle/package detection on my front door camera reliably.
https://huggingface.co/microsoft/bitnet-b1.58-2B-4T#evaluati...
Which LLM use cases can be solved with compact decision trees is an awesome open problem.