Hacker News Reader

Comment by nicce | Hacker News Reader

We have likely seen the cheapest prices already. Once we can’t function without them anymore - go as high as you can!

By then comparable or even better models will easily run on edge.

So if they crank up the prices we could just switch to local and not get lured by bigger and bigger models, rag, Agentic, MCP driven tech as if all of that couldn't run locally either.

I am not as optimistic that locally run models will be able to compete anytime soon. And even if, the price to run them means you have to buy the compute/gear for a price that is likely equivalent to a lot of 'remote' tokens

The most meaningful models will run in the future on those trillion dollar data centers that are currently being build.

> By then comparable or even better models will easily run on edge.

What are you basing that on?

Presumably your goal is to extract some practical value from this and not just higher benchmark numbers. If you can get the functionality you need from last-gen, there's no point in paying for next-gen. YMMV.

Indeed that was the premise that we would be a step behind when running on edge. That's already the case.

Hopefully we get more competition and someone willing to undercut the more expensive options

It's more likely the shareholder zeitgeist will soon shift to demanding returns on the ungodly amounts already invested into AI.

Entering the market and being competitive gets more difficult all the time. People want the best and fastest models - can you compete with trillion dollar datacenters?

You might be right, but there's plenty of deep pocketed companies who are still very excited to compete in this market.

You know that competition is a thing, do you?

Reply on news.ycombinator.com