745 karma · joined February 7, 2025
No need for database MCP, I use postgres and tell it to use psql.
Occasionally I use prettier to remove indentation - the LLM makes a lot less edit errors that way. Just add the indent back before you commit. Or tell pi to do it.
Pi itself is a minimalist coding harness with a tiny 1500 token system message and only read, edit and bash as tools. I only discovered it a few weeks ago and it is surprisingly powerful with a local Qwen3.5-35B - especially as it allows to keep the context low.
Mario's blog posts are not easily digestible (imho) until you have read a few of them but they have plenty of profound thinking. His blog is for me the first one in years where I have spent an hour to read several posts.
Mario is deeply rooted in the OSS system and basically that is what he is talking about here in this post. That said, I have no idea what earendil is doing, except that it is based on pi.
Edit: My personal take - "I've sold out" is very much Austrian style because actually it is the opposite. To quote one thing from the post:
"Then Miguel and Nat approached us. Long story short: we sold RoboVM to Xamarin. A short while later Xamarin closed-sourced our open-source RoboVM core, quickly followed by Xamarin selling to Microsoft. Then Microsoft shut down RoboVM immediately.
While there was some monetary gain, everything about this fucking sucked."
So Mario did a lot of vetting to hopefully avoid this from happening again.
Who downvotes that? It is true.
Edit: maybe you can illuminate why you downvote?
Tongue in cheek: we urgently need fusion power plants. For the AI and the helium.
Or not. https://www.welt.de/wirtschaft/article152318777/Wassersparen...
Edit: parent changed his answer, I have included it now.
It would make much more sense to import (renewable) electricity from Spain to Germany than strawberries.
The 'balcony power stations' are the same thing. They get subsidised, and you even get a fixed kWh price when pushing into the grid.
The problem is that in the end it will become more expensive for everybody because at times you have a surplus driving the whole sale electricity prices into the negative while still paying fixed prices for injection into the grid.
To make this economically viable, you have to have everyone paying spot prices. Everything else is just green ideology driven inefficiency.
Just to make it clear, I think renewables are an important option for the future. But to make them a viable option of the electricity energy mix, supply and demand, storage and grid capacity need to be taken into account.
Last not least, there is plenty of low hanging fruit to drive CO2 emissions down: drive up the truck tolls. Currently you have potatoes farmed in Germany, driven to Poland to get washed, transported to Italy to be converted to french fries and transferred back to Germany into the super markets.
Same goes for home office, during Covid it was possible for many workers to continue with their work. Does an accountant need to drive to an office every day? Nope. How many business trips could be replaced by a video call?
If the CO2 emissions problem is to be solved rather sooner than later, the money has to be spend efficiently as there isn't enough of it.
printf '\e]8;;http://evil.com\e\\https://good.com\e]8;;\e\\\n'
The next step would be to embedd a full javascript VM in the terminal and a CSS engine.[1] From the Life of Brian
Definitely plenty of people further up the corporate ladder were not happy with the success, while the top is likely too far disconnected to understand.
I think OpenAI's IPO will be interesting. Not even the conservative media will be happy about mass surveillance of Americans.
For non-Americans not much change, they don't really care about your rights more than about a pile of dog poo.
Yesterday I tested the latest llama.cpp and the result is that PP has made a huge jump to 420 tps which is 30% faster than MLX on my M1. TG is now 25 tps which is below MLX but does not degrade much, at 50k context it is still 22-23 tps.
Together with Qwen code CLI llama.cpp does a lot less often re-process the full KV cache. So for now I am switching back to llama.cpp.
It is worth to spend some time with the settings. I am really annoyed by the silly jokes (was it Claude that started this?). You can disable them with customWittyPhrases. Also setting contextWindowSize will make the CLI auto compress, which works really well for me.
And depending on what you do, maybe set privacy.usageStatisticsEnabled to false.
Like Gemini, Qwen CLI supports OpenTelemetry. When I have time I'll have a look why the KV cache gets invalidated.
I have tried many tools locally and was never really happy with any. I tried finally Qwen Code CLI assuming that it would run well with a Qwen model and it does. YMMV, I mostly do javascript and Python. Most important setting was to set the max context size, it then auto compacts before reaching it. I run with 65536 but may raise this a bit.
Last not least OpenCode is VC funded, at some point they will have to make money while Gemini CLI / Qwen CLI are not the primary products of the companies but definitely dog-fooded.
"Ljubisa Bajic desiged video encoders for Teralogic and Oak Technology before moving over to AMD and rising through the engineering ranks to be the architect and senior manager of the company’s hybrid CPU-GPU chip designs for PCs and servers. Bajic did a one-year stint at Nvidia as s senior architect, bounced back to AMD as a director of integrated circuit design for two years, and then started Tenstorrent."
His wife (COO) worked at Altera, ATI, AMD and Testorrent.
"Drago Ignjatovic, who was a senior design engineer working on AMD APUs and GPUs and took over for Ljubisa Bajic as director of ASIC design when the latter left to start Tenstorrent. Nine months later, Ignjatovic joined Tenstorrent as its vice president of hardware engineering, and he started Taalas with the Bajices as the startup’s chief technology officer."
Not a youngster gang...
a) to have an idea how much tokens I use and
b) be independent of VC financed token machines and
c) I can use it on a plane/train
Also I never have to wait in a queue, nor will I be told to wait for a few hours. And I get many answers in a second.I don't do full vibe coding with a dozen agents though. I read all the code it produces and guide it where necessary.
Last not least, at some point the VC funded party will be over and when this happens one better knows how to be highly efficient in AI token use.
Are you sure about that? If true it would definitely make it look a lot less interesting.
Tech summary:
- 15k tok/sec on 8B dense 3bit quant (llama 3.1)
- limited KV cache
- 880mm^2 die, TSMC 6nm, 53B transistors
- presumably 200W per chip
- 20x cheaper to produce
- 10x less energy per token for inference
- max context size: flexible
- mid-sized thinking model upcoming this spring on same hardware
- next hardware supposed to be FP4
- a frontier LLM planned within twelve months
This is all from their website, I am not affiliated. The founders have 25 years of career across AMD, Nvidia and others, $200M VC so far.Certainly interesting for very low latency applications which need < 10k tokens context. If they deliver in spring, they will likely be flooded with VC money.
Not exactly a competitor for Nvidia but probably for 5-10% of the market.
Back of napkin, the cost for 1mm^2 of 6nm wafer is ~$0.20. So 1B parameters need about $20 of die. The larger the die size, the lower the yield. Supposedly the inference speed remains almost the same with larger models.
Interview with the founders: https://www.nextplatform.com/2026/02/19/taalas-etches-ai-mod...