841 karma · joined September 19, 2011
Would you stand by this statement if we did s/Netherlands/United States/g ?
It's not about the governments of today, but those of the future.
> Withering, an open source Withings app written in Rust.
Why not buy a Low End Box and run one of the WG Setup scripts to get you going? You'll lose the anonymity, but its your box, a clean IP, significantly cheaper than a commercial vpn.
Not completely true. It's memory AND memory bandwidth. You can have 1tb of memory but if you have awful memory-bandwidth you'll also have slow tok/s. A3B helps with this, but so does MTP.
From my experience, you'd be better off running the dense 27b-mlx with MTP than the 3.6 version with A3B. You say your model is ~20GB of ram, but the 3.8:27b-mlx is 18GB and gets me very reasonable tok/s, and greater speed if you disable thinking when not required.
Qwen's advances do (currently) have merit.
Surely you don't want them to be the reason the bubble bursts?
Edit: Having used qwen3.8:27b-mlx on MBP M4 64GB, I get around ~45 tok/s. A3B would be great for smaller devices, but it's definitely usable. As I understand it it's a mixture of MLX and MTP.
The main improvements lately were:
- line/function prediction
- Claude Code plugin
And I can use Claude Code in any terminal. So I've switched to zed.dev and use Claude there. Wish it had the line prediction though.