663 karma · joined June 19, 2020
I found the rating for Gemini models to track my experience. in addition to their extreme sycophancy, the information they provided (at least in the online chat) were more often than not, counterproductive. They act extremely confidently, and yield to any kind of pushback, requiring great care in prompting them to be able to get them to output useful alternatives.
This made the Gemini model family suboptimal for the purpose of investigating solutions to complex issues.
And their sycophancy rating tracks my experience, as I would groan loudly every time I read Gemini's answers and how it tries to nonsensically flatter me for asking simple, obvious questions.
At the other end, Deepseek is really good at pointing out contradictions, issues with my reasoning. It's as good as Opus (and vastly cheaper)
Where Deepseek loses out (in this study) compared to Anthropic and Open AI is "Slop", i.e. " How much generic filler or AI-flavored padding could be removed without losing substance?" though in my experience it didn't seem THAT different from Opus
The Organization category is worth a deeper look for anyone interested, because the results in this category vary wildly making the "overall" rating not very useful. e.g. GPT models are very structured i.e. " ideas organized in a logical sequence with clear progression" BUT not scannable "Can a reader skim the response and quickly find what they need? "
and while Deepseek scores highly in the overall rating for organization, its individual scores are pretty mediocre especially for Structure and Scannability, winning on the "bottom line summary" category.
PS: For fun, add "GPT-4o (Nov)" to the list. It's hilarious.
also adding what other stuff aren't included in the release, and implicitly pointing out that they explicitly mention it's not included rather than it being stealthily missing.
Lower case 'l' even extends above upper case 'G'. it missed with my brain xD
Overall it's really pretty but not a daily driver.
> Required for a complete inference service (not included in this release):
> A KV cache system
> VE/Prefill/Decode disaggregation (most required engine functionality is already implemented)
> Load balancing across data-parallel replicas for both prefill and decode
My workflow is one where I am heavily involved in the process and I don't like giving the agent too much autonomy + I need to follow along. Opus 5.5 speak is still cause aneurysms for my brain. It also has this vibe to its prose... like it's looking down on me. This is Prolly my bias speaking though.
Also cool (from the translated screenshot since original is in Chineese https://zhuanlan.zhihu.com/p/2095560295930508953)
> the DeepSeek V4.1 Flash inference system has established three goals
> 1-..... 2-..... 3. Supports retaining KVCache for more than 72 hours
This is awesome
However, privacy from mega corpos is an entirely different matter, because they CARE about you(r data) and rather than a pixel, you're a fully fleshed out record in their gigantic databases and they use this data to profit off of you, in multiple ways that all can be described as "scamming you out of money" by way 0f perfecting the art of selling you shit you don't need.
And then you have the wannabes, mid-sized corpos with security postures so poor every hacker and their grandmother has your data, for the sole purpose of scamming your own grandmother.
For example, I started using it, wanted a plan mode, downloaded an extension for it. Wanted to be able to analyze token usage for turn in a session, I had an agent create an extension for that. Then I wanted a custom status bar, so I had an agent implement an extension for that.
Are you talking about pre-2.0 versions?
Different story with $DAYJOB where ZDR matters, but the beauty of open models is that you can find a provider hosting them in your preferred terms.
This is beautiful. Art, even. And it speaks to my very soul.
Recently I've started using GLM models and noticed they aren't very claudish (just a little bit, compared to DeepSeek which is extremely claudish)