Is that on a single 3090? I need to change my settings it sounds like
1,307 karma · joined April 14, 2026
That's why a lot of people have been freaking out about local LLMs since april. There's finally a decent model that runs locally on a GPU or two that can do agentic programming at a reasonable enough tokens per second.
I seriously don't know how people are working like this now. I'm on my ass looking for work and in the last month it feels like everyone has completely lost their minds.
No one is saying a local model will give you anthropics business in a 5min download. People are saying, "hmm, maybe I should do this one locally". People are also saying "this is surprisingly good enough for me given the trade offs"