Hacker News Reader

Comment by nightski | Hacker News Reader

It's too valuable of a tech to remain in the control of any corporation. Open models will find a way. Compute requirements will go down and there will be many of us making it a priority to transform the tech into something open like the Linux kernel vs a closed cloud tech.

Nvidia has 75% profit margins right now. That won't continue forever. It may take quite some time but it will normalize.

View on HN

Unfortunately, there's really no clear path to viable local models for the common folk, the hardware requirements are just too extreme. I say this as someone with a pair of A100s that is absolutely delighted by what the open source models are capable of, but even with the best harnesses, tiny quantized models are just not even close to the same league as something like Kimi-k2.

Of course, here on HN it's easy to find folks who get a lot out of tinkering with tiny models, but the masses don't want to tinker with toys, they want something fast with a large context and approximating at least Opus 4.6 level reliability and capability, which simply can't be squeezed into a quantized 60b model.

Right now, yes but I am fairly confident this will change. Not only do I truly believe we will see massive efficiency gains in inference, I also believe the cost of hardware will come down. Again Nvidia's getting a 75% margin on this hardware. Usually hardware margins are significantly smaller. More supply will come online even if that takes years.

Reply on news.ycombinator.com