Hacker News Reader

Puts into perspective how cheap the frontier models are via subs or even API.

You can't really compare API prices though. The cards that they are running frontier models on in the datacenter can service hundreds of simultaneous requests and are at nearly 100% utilization. This thing would sit on your desk and be used to service a single user for a couple hours per day.

It is the locally ran models that get me excited. They have an immutable user agreement and a focus on privacy.

Subscription / on-demand polices are a moving target, along with cost.

I foresee the ML market replicating the video streaming services market. Join us at a low rate and no advertisements. Six months latter, advertisements for everyone, unless you pay more $$. Now $$ will still show you ads. We are raising the rate to $$$ with adds ...

The main subsidy, from OpenAI, is ending 10/26. It’s still “cheap” for now compared to all the other non-open weight frontier models, but it won’t last since OpenAI’s stated goal is to make it so that there’s no much of a difference price wise between on demand API calls and subscriptions

Reply on news.ycombinator.com