Hacker News Reader

hirako2000

You've got to understand, proprietary models operate as the following:

- release: full precision, debrided, uncapped context

- shortly after, hooked: quantized, governance department slammed, and a pseudo large context, attention reduced to start and end of thread.

- down the road: 4bit quantized or worse with nerf incantation to make the next upcoming model feel amazing.

Rince and repeat.

View on HN

They have to be doing some variant of this in the life cycle because of how wildly the performance changes over time. I refuse to give Anthropic my own money because the subscription plans are essentially useless. It's rather nice with a company API account with no spending limit though. But really oAI models are more consistent over time in my experience.

Reply on news.ycombinator.com