I hope this is a joke. But most of the LLM research and inventions come from China? The best papers are from DeepSeek? You either get the data by stealing from humans or distilling from bigger models?
7,164 karma · joined October 24, 2010
I hope this is a joke. But most of the LLM research and inventions come from China? The best papers are from DeepSeek? You either get the data by stealing from humans or distilling from bigger models?
I don't know man, maybe this is not super serious what I'm doing. Some systems stuff with rust, implementing my own desktop apps with iced, porting old DOS games to Linux...
It is a very good model.
Lithos promises even faster speeds if you want to pay more.
6 is worse than 5.6 here.
But it is amazing on generating a report on content generated by better agentic models such as DeepSeek or GLM, which both do a mediocre/bad job on reports.
I am having 98% my input in cache, so using Coralbricks makes sense due to them giving cache reads for free — you only pay for writes. I spend maybe 5-10 dollars a day and my agents basically work day and night implementing things for me.
If your tasks are write-heavy, find a provider with cheaper output.
If you build a customer-facing app, pay a bit extra for 400+ tok/s e.g. on Lithos.
Maybe I should try the flash...
And now if you get the task done faster with the same quality. And the cost is 80 cents, considering DeepSeek and your own server starts to starts to be relevant...
I am eyeing a huge codebase built with Opus. Did multiple passes of refactoring for things like using traits not just free functions. And using the Rust types like PathBuf from the damn standard library not just strings everywhere.
Oh and it is so hard to use a crate. Let's just vibe an inferior version and push another 5k line PR. Nobody reads them anyway right? Logos schlogos, a lexer is easy to write, right?
Maybe I am just getting old, but I remember a time when we were proud on the code we wrote. Now I read some of the old stuff and get a bit sad for what we lost.
Don't get me wrong DeepSeek also does this. But if the model is 100x more expensive I expect better. Of course if you never read the code it's ok. But it does the same mistakes and cannot design great architecture...
With structured tool calls you do want to be lenient on parsing, but that is a very small price to pay when the model is 100x cheaper.
It is great on creating summaries and content.
Maybe it is due to us being all very experienced devs. And can steer the model. But my daily routine is just to have 8-9 Zellij tabs open, DeepSeek in omp in each, and grind research and code day and night. Really nice model...
What I'm looking for with this is of it hallucinates less that DeepSeek with its sparse attention, and can be used in better summarization and content generation in multiple languages.
DeepSeek sucks with languages other than English and China.
The price is really good with ML4.
Now my provider serves DeepSeek around 300 tokens a second. The code is shit but I can have a few more rounds of corrections.
DeepSeek was maybe a dollar for the full PR. Opus/Astra over 50 dollars. And double that if you use their fast variants which matches the DeepSeek speeds on certain providers.
Yes, it is so good I rarely test new models anymore. Or think about cost.
Now the codes are with you and not in your phone or in the cloud.
BTW all the women I know in my age group watch porn too...
Then I installed helix and I just use it without config.
If you like configuring things take pi, if not omp is pretty much great defaults.
Use the model through a fast and reliable provider such as Fireworks directly, skip OpenRouter.
What harness you are using?
There is no reason to pay API prices for Anthropic and OpenAI if they don't cut them down 100x at least.