1,332 karma · joined February 14, 2015
I think it is closer, although still even it has a cold start problem. Once you are connected and in-session, it is a better experience.
There is still some "turn based" conversational aspect to it that can be awkward but it is much better. It also helps that you can "tap and hold" to override, which is a bit of a hack but works well in practice for that mobile use-case.
The OpenAI "Voice Mode" is closer, but when we can have near instantaneous and natural back and forth voice mode, that will be a big in terms of it feeling magical. Today, it is say something, awkwardly wait N seconds then listen to the reply and sometimes awkwardly interrupt it.
Even if the models were no smarter than they are today, if we could crack that "conversational" piece and performance piece, it would be a big difference in my opinion.
[0] https://www.reddit.com/r/LocalLLaMA/comments/1gpr2p4/llms_co...
I don't deny that performance for certain logic tasks goes up with these models but I don't fully understand what role the thinking tokens take in these cases.
There is Hugging Face's "Open-R1" project which is attempting to replicate the DeepSeek-R1 model given the innovations outlined in the paper(s). They need to replicate the training code, the datasets, etc. This part of the system wasn't published.
And you are right that with the open weights of the R1 model, it should be pretty easy to infer how much it costs to _run_ as well.
It was "correct structure, wrong answer", "correct answer", "wrong answer". This was for Math & Coding, where they could verify answers deterministically.
- fp8 instead of fp32 precision training = 75% less memory
- multi-token prediction to vastly speed up token output
- Mixture of Experts (MoE) so that inference only uses parts of the model not the - entire model (~37B active at a time, not the entire 671B), increases efficiency
- PTX (basically low-level assembly code) hacking in old Nvidia GPUs to pump out as much performance from their old H800 GPUs as possible
Then, the big innovation of R1 and R1-Zero was finding a way to utilize reinforcement learning within their LLM training.
Or perform operations on your local computer?
Have you had issues with it?
> Mistral Remove "Committing to open models" from their website
That was 5 hours ago.
Without having insider details it is hard to know why, but the coincidence of timing with the Microsoft deal is not lost on me. It could have even been a stipulation.
Tons of young people still play sports and are physically active. Maybe it is just the bubble I live in, but kids who are on even rec leagues from 5 years old on are engaged in organized sport activity multiple nights a week.
Things are about to get dark unless we have new methods for combating it. It has seemed like Google has been on a slow and steady decline, losing this battle with spammers. This takes it to a whole new level.
> “Early in the Reticulum-thousands of years ago-it became almost useless because it was cluttered with faulty, obsolete, or downright misleading information,” Sammann said.
> “Crap, you once called it,” I reminded him.
> “Yes-a technical term. So crap filtering became important. Businesses were built around it. Some of those businesses came up with a clever plan to make more money: they poisoned the well. They began to put crap on the Reticulum deliberately, forcing people to use their products to filter that crap back out. They created syndevs whose sole purpose was to spew crap into the Reticulum. But it had to be good crap.”
> “What is good crap?” Arsibalt asked in a politely incredulous tone.
> “Well, bad crap would be an unformatted document consisting of random letters. Good crap would be a beautifully typeset, well-written document that contained a hundred correct, verifiable sentences and one that was subtly false. It’s a lot harder to generate good crap. At first they had to hire humans to churn it out. They mostly did it by taking legitimate documents and inserting errors-swapping one name for another, say. But it didn’t really take off until the military got interested.”
> “As a tactic for planting misinformation in the enemy’s reticules, you mean,” Osa said. “This I know about. You are referring to the Artificial Inanity programs of the mid-First Millennium A.R.”
> “Exactly!” Sammann said. “Artificial Inanity systems of enormous sophistication and power were built for exactly the purpose Fraa Osa has mentioned. In no time at all, the praxis leaked to the commercial sector and spread to the Rampant Orphan Botnet Ecologies. Never mind. The point is that there was a sort of Dark Age on the Reticulum that lasted until my Ita forerunners were able to bring matters in hand.”
* Mega-corporations with immense power and influence over all of society (Kodak of Kodak)
* Drug dens offering synthetic designer drugs that made people feel as if they were various animals.
* The protagonist receiving an upgrade to his nervous system, including a tooth-based switch that allowed him to 'speed up' for brief periods.
* Status symbols of the ultra-rich, such as using the most elaborate physical conveyances in an era of effortless teleportation.
I'm probably missing some, but it felt like such a prototype novel to something like Neuromancer and was written in 1956!
Though if Gibson is the father, I might say Bester is the grandfather.