oh_no

yeah and this isn't a long term solution, stand this up, see what value you get out of it, and in a few months you cans witch to whatever the best decision model is

I think releasing something like this makes sense even if it's underbaked, it's still very cheap, and if you have existing enterprise OpenAI relationship it's a lot easier to onboard something like this than set up a new Jev contract.

How these models play out is an open question but existing provider contracts and T&C are important for enterprise.

Yeah, very similar benchmarks at 1/4 the price. I've been pretty happy with Luna 6 though I still think the gap between small and frontier models is larger than many people want to admit.

> Impressive vision benchmarking. If the vision model is truly as good as astra, that would make it best in the world.

Sure, it leads in one unpopular benchmark with internal numbers.

But look at the third benchmark. It only has Sol 5.6 from OpenAI and it shows a 12.8. I don't know this benchmark but AA's GDP.pdf listing has Sol 5.6 Max at a 27, even non-reasoning beats the 12.8. It's extremely weird to cherry pick Sol 5.6 and then also lie about the published third party benchmark score. I'd love AI companies to stop lying about this stuff.

AA - https://artificialanalysis.ai/evaluations/gdp-pdf?models=cla... Mistral announcement - https://mistral.ai/_astro/multimodal-benchmarks---gdp.pdf---...

you don't explain the advantage of workers over pages for a static site

i've done this several times recently

however now i just have agent do it with CLI and that works well and I don't have to find the secret link

yeah it's 100% the wrong move for them to make, I think there is probably a lot of value in AI driving Figma, and if I can't do that, Figma will fall out of the ecosystem.

i believe they've got inference issue. the phone app never got past 3.6, and they're going to roll this out to Ultra subscribers before other subscribers. none of this screams they're ready to flip a switch and start serving a ton of traffic as OpenAI/Anthropic routinely do.

nothing about this announcement gives me confidence that google is back on track as a model provider.

3.8 flash is more expensive than sol 6.0, google uses a LOT of reasoning tokens

Sol 6 is in there? You may be on Enterprise where it didn't roll out by default and comes out in a week or so. (Which is a weird and bad change to their model releases.)

i'd love to see them re-enter that space but given haiku 5 never happened I wouldn't bet on it

i think they see what openai charges for luna and just don't want to try and compete

it could be that, it could also be that sonnet max looks to burn about 60% more tokens than opus max

AA intelegence index (agent harness doesn't have sonnet data yet) on max: Astra 27k Fable 5.1 78k (Sonnet 5) 118k Opus 5.5 119k Sonnet 5.5 193k

Opus 5 was previous record holder so hats off to Anthropic on blowing it away on token churn.

microsoft Product remains an unmitigated dumpster fire.

i think github copilot has actually gotten to a pretty good place, and of course the two copilot products will both have features called "autopilot" that do entirely different things

look at token use, 3.8 flash is a huge token hog compared to openai models

Why do you think this uncracked code was so simple to solve?

And it's very possible Terra or GLM could crack it, turn off their web access and try yourself.

shutoff for existing models, new models stopped as of that announcement, astra will never be on cursor.

which is crazy because this was grok's competitive advantage, worse than OpenAI models but better than everything else, now it's less efficient than Opus or Fable 5.1

the AA numbers are generationally bad. double token use (the one thing Grok was good at was low reasoning usage!) to gain 5% in the benchmark score. with reportedly a larger model. maybe it shows gains IRL but wow, I've never seen a new generation model look so underwhelming compared to the last.

It still works, bots can solve it but it probably increases the cost of that web call by 10x or 100x for that bot, so it won't bother. Had a recent bad experience with removing recaptcha.

I get this pretty frequently on windows Firefox after switching to it, note this is my work computer, Firefox works fine at home on more open network

Very nice to see that this is even more token efficient than Sol, when Fable 5.1 is less so than the already bloated token budget of Fable 5.

that's all openai models but i'm very happy openai continues to focus on efficiency rather than reasoningtokenmaxxing

the last thing nvidia would want is to make ai look more legally risky

to say nothing of their massive investments direct and indirect in openai

with Fable 5.1 increasing token use pretty dramatically I'm again impressed that OpenAI seems like the only lab to be driving token use down. The ExploitBench Internal Port chart showing token usage is crazy impressive

you dont like giving openai money but you're fine with spacex? not criticizing, just trying to understand.

cursor adds $0.25/M to your token bill for 3rd party services. sounds small but it's insanely big on cached inputs, which are an insanely high % of use

1. I think LLMs will end up pretty dramatically shrinking MTTR, a lot of that will be tooling to proactively resolve problems as soon as they start, but a lot of it is that agents are very good at finding and fixing problems by correlating data, something humans can do but I think we're going to be slower at 2. "The models are down" doesn't seem like a very realistic problem unless you have a single provider/set of endpoints. I do not recommend this setup but I guess if you have a single point of failure that is a risk.

very easy to lose money on subscription, very easy to make money on api pricing

what? enterprise LLM API contracts pay listed model rates. how could they lock you into pricing on models that they've not developed yet?

enterprise SaaS LLM calls do lock in rates but don't lock in models for similar reasons to the above.

yes and no, anthropic and openai are losing money on people who max out their sub, but openai has a lot more room to play with with much cheaper models to serve (by all signs we have from actual api/task pricing)