Of course, benchmarks don’t tell you how much it will cost on your workload.
GLM 5.3 was more expensive than Haiku and Sonnet 5.5 on a workload I was testing recently despite being much cheaper on the price sheet.
4,823 karma · joined October 28, 2016
Of course, benchmarks don’t tell you how much it will cost on your workload.
GLM 5.3 was more expensive than Haiku and Sonnet 5.5 on a workload I was testing recently despite being much cheaper on the price sheet.
Opus 5 is fine for me and works better and faster on low and medium than higher effort on prior versions. Same as 5.6 Sol compared to 5.5 or 5.4.
There’s also the frustration of it not quite being enough sometimes. It’s extremely capable, but I still find that it needs more concrete guidance and boundaries than other models.
Maybe I missed it, but it doesn’t tell you if it’s more successful for less overall cost?
I can easily make Sonnet 4.6 cost way more than any Opus model because while it’s cheaper per prompt it might take 10x more rounds (or never) solve a problem.
It’s typically equivalent, sometimes better, sometimes behind. Better at following a well defined plan, less good at concept exploration and planning imo.
At 1m context it’s basically the same price.
I was using both Codex and Claude Code heavily on some projects this weekend.
In one project Codex was screwing everything up and in another one absolutely killing it. I’ve seen the same from Claude.
In the bad Codex example it had the wrong idea and kept trying to figure out how to accomplish the same thing no matter how many times I attempt to correct it. Undoing the recent changes where it went down the wrong path was the only way to get things back on track.
I wonder if context poisoning is a bigger problem than people realize.
GM vehicles had been notorious for having poorly adjusted headlights from the factory. The fact that Xenon systems seemed to always come with auto leveling and LED often does not is crazy.
Lots of big cities have grocery stores with parking garages under them, doesn’t seem much different.
I would be curious to know what their reasoning was.
I think mine would be that since these agents seem to face absolutely no consequences for their far more egregious actions. Why should something so minor result in jail time. To be clear, I’m not talking about their lawful actions. I’m talking about them assaulting and abusing people and excessive use of force that’s been captured on camera all across the country.
My hypothesis is that people generally feel that police face little to no accountability and so there is a more serious double standard to contend with.
2022: https://www.xda-developers.com/google-pixel-3-update-emergen...