Not sure I will give up on smolvm though.
I have scripts to launch an instance per task. Nono wraps my coding agent.
I provide the git clone for the specific task.
It works really well.
472 karma · joined February 21, 2023
Not sure I will give up on smolvm though.
I have scripts to launch an instance per task. Nono wraps my coding agent.
I provide the git clone for the specific task.
It works really well.
DS4.1 Flash not really cheaper than frontier models???
It is insanely cheaper.
It costs pennies and you got really great output.
The author is spot on.
There is no way I can beat even local models at generating complex Python scripts fast.
hn is filled with uber geniuses.
They want to make you feel dumb and useless with your software development knowledge.
Unless you use a zero data retention inferencer?
These should be decoupled.
Maybe I need nono in one context and smolvm in another or both.
I would not want to trust the harness to self policy.
I see posts about OpenAI and Anthropic latest and don’t even care looking at what they do better. I just read the comments here.
I use DS4.1 Flash and GLM 5.3 Flash, pay peanuts per day and get more than acceptable results.
shocked Pikachu
Did you know there are tensions in Switzerland because there is a will to stop kids from learning French while they attend primary school? https://www.edi.admin.ch/fr/newnsb/CbsqmmLpkhDjQgEILMp_P
Did you know Switzerland is located in Europe and shares a border with France? Did you know people in France speak French?
Do you know where Quebec is located?
I’ve seen your kind before.
You will be able to run some pretty impressive models locally. Good for you.
What other place do you know of whose context is the same as Quebec?
It’s a good thing we have access to those very cheap and useful Chinese models.
- Qwen3.5 9B
- Qwen3.6 35B A3B
- Qwen3.8 27B
- Gemma 4 26B A4B
- Gemma 31B
- Muse Glimmer 30B
I have 48G.The MacMini is used solely for inference. llama.cpp + llama-swap.
People are saying local models are crap and serves no purposes.
I use them to help me spell check, write emails, write text messages, write JIRA tickets, write PR comments, etc.
I also use them in coding agents to complete different tasks.
I find them quite useful!
Otherwise DeepSeek Flash 4.1 is dirt cheap (other "Flash" models are not that expensive either). I pay (very few dollars) out of my own pocket.
There are many things where having an API Key is necessary.
Maybe I’ve missed the boat though: is there now a method to use an api key to access a subscription?
You would think, following the absolute horror that was, that any civilized nation would not use such a tool in such capacity.
Or rather, it showed it was working wonderfully for cases where war crimes is a goal.