HNHacker News
TopNewBestAskShowJobs

_ache_

846 karma · joined October 30, 2021

submissionscomments
_ache_··on Fine-tuned Qwen on my 16gb GPU to respond without the letter e
Qwn is, I think, an à propos alias.
_ache_··on Ink droplets in motion snag top prize in Nikon Small World contest
The video is nice but the movement is inverted from the photo.

I would like to redo the setup myself.

_ache_··on Concerning behavior from a popular open-weight AI model
We've already caught Claude launching claude himself to get around the session restrictions. Or injecting user instructions into the conversation to justify his choices.
_ache_··on Microsoft offers mass buyouts for roughly a quarter of its workforce
Any idea why?

The "internal" memo: https://www.businessinsider.com/microsoft-is-offering-buyout...

_ache_··on IBM CEO says open weight models are now good and cheap on-prem
I'm sorry. Yeah Gio is only in french, I forgot to translate the unity.

octet => byte, https://fr.wiktionary.org/wiki/Gio

_ache_··on IBM CEO says open weight models are now good and cheap on-prem
I mostly run Qwen3.8 Flash Next on 2xR9700 (but Intel Arc Pro B70 may be better currently, or 4x3090 is even better but out of budget, 32GiB Nvidia GCs on ebay are also usable). I have 128GiB DDR4 (3200Hz), but 64GiB is enough, even 32GiB maybe, I just reuse it from an old project.

You may need a AMD EPYC processor and associated motherboard, don't forget a good PSU at least 1200W (300W processor + 400W by card to support spikes of consumption). On some setup (~15k€) you can use 4 CG to go up to 128G of VRAM.

I'm not using a EPYC processor for now, so I get 170tps on decode but very slow prefill, the bottleneck is the PCIe exchange between the cards, I need to setup P2P (it means what you think it means, for GCs).

My setup supports full context (2*18 bytes so 256K), I didn't setup YaRN to get 1M of context (2*20 bytes), but it's an option with 128GiB of RAM, the visual component is extracted from RAM so a little slower. I'm not using multiple agents but some people does, it's god like with 4 graphics cards, on 2 only, it's relatively quick but limited to single user and up to 3 to 4 concurrents requests only.

It's not frontier, but look AA of QFN, it's good enough. DeepSeek V4.1 can run on my setup, but it's slow. On dual B70, there is some PoCs to make it usable (>60tps). It improves every days.

If you need more information, look for local setup users on the Web. There is a lot of people sharing information about benchmarks and setups. L80 is my reference for now.

Edit: I translated the unity.

_ache_··on IBM CEO says open weight models are now good and cheap on-prem
I'm building a local LLM server myself. For about 8k€ you can have 170tps, ~6000 prefill.

A lot more with Haiku equivalents (Qwen3.8 27B) or gemini. It's not frontier, but not that far away.

_ache_··on A complete bypass of eMudhra’s 1FA OTP login system
eMudhra may be exiting the global SSL/TLS certificate business, but that won't fix its security culture. It's not even 2FA, it's 1FA.
_ache_··on Chrome and Edge are removing XSLT: what breaks and what does not
Chrome is putting a big red button on any site using XSLT. I'm for my RSS feed. It's ugly, I will have to move to another solution. It works fine on Firefox.

Ex: https://ache.one/en/rss.xml

_ache_··on Chrome and Edge are removing XSLT: what breaks and what does not
Anyone getting 403 Forbidden?

I can't load this page.

_ache_··on Gold is now the top U.S. export
The value of Gold isn't linked to any currency. Money is just paper (or a number) and can be de-valuated. Gold doesn't.
_ache_··on Gold is now the top U.S. export
If you have USD and you think it will value less soon, you change it to gold instead. If you own gold in the US and think that the USD value will drop very low, you move out of the USD fearing gold retention.
_ache_··on Gold is now the top U.S. export
If you think that USD value will drop sharply, it's a logical thing to do.
_ache_··on Amsterdam police confiscates server left-wing ISP A/I at American request
If you claim that, you have to back it up.

Otherwise, assuming there are Zionists everywhere is borderline antisemitic.

_ache_··on Hackers activate automatic defrosting in supermarket fridges across Europe
It is a way to move the responsibility to the "users".

But the hack has already been disclosed and it's the responsability of the manufacturer to ensure that the fridge keep ever up to date or offline.

As with the USA Defense hack, it could have been prevented.

The hack: https://blog.claroty.com/team82/research/freeze-the-controll...

_ache_··on A statement on the Tor Project's relationship with Mullvad
You either are just lying or are profoundly miss informed.

The budget they present on 6 of October is absolutely not social or even support a welfare state. The only thing "socialist-like" is retirement at 62yo, only for people starting to work at 20yo.

The vote at the national assembly state that they are right or far-right oriented.

- https://www.lemonde.fr/idees/article/2026/10/08/au-rn-un-ser... - https://datan.fr/groupes/legislature-17/rn

_ache_··on A statement on the Tor Project's relationship with Mullvad
Yes, it should absolutely disqualify the OP. Even if the RN wasn't called explicitly as I cannot find any French far-right labelled party with a socialist economics. None.

The main one is RN, François Asselineau is maybe the more "lefty compatible" far-right candidate, and he is clearly "right" labelled, not a lefty.

_ache_··on A statement on the Tor Project's relationship with Mullvad
> but are fine with Mullvad saying that.

but are fine with Mullvad having the right to say that.

_ache_··on Imposing Sanctions on the International Criminal Court
Yes, the CPI did manage to move out Microsoft / Google. I bet Apple is harder to escape.
_ache_··on OpenDLSS: A Vulkan Reimplementation of Nvidia's DLSS 5 Neural Rendering Network
From the LICENSE

Copyright (c) 2026 maan

So... Either alooshdenny stole the commits, or it's an alias for maan.

_ache_··on Qwen 3.8 Omni Flash
Yes, that was my point. Good but too niche.
_ache_··on Qwen 3.8 Omni Flash
You point is valid for textual LLM, with large CoT, not Omni which will respond quick with a voice. In this case, token price is a good enough proxy.

What matter the most and isn't told by token price is the latency. You expect a voice LLM to respond very quick. If it takes 5s to response to a simple "Hello, what the weather today?", them not much people will use it.

_ache_··on Qwen 3.8 Omni Flash
Very capable yes but very slow. 27B is relatively easy to run, but the 125b one need around 128Gb of RAM (DDR4 isn't enough, you need DDR5 to be quick enough, that's $3000 alone, you also need a graphic card). DDR4 is caped @20tps.

So, the cost of a setup to run Qwen-Flash-Next at +40tks is around $3000. Too much for most people.

With only a RTX 4090, you will reach 30tps (with DDR5...), not +40tks, and it's about the limit to be usable. Oh ! I forget Apple device too, it's a good option to run this model I guess, but still slow.

Yet, as you said, it's still a wip implementation, it may improve soon (MTP support is about to be merged in llama.cpp soon).

_ache_··on Shapelearn Qwen 3.8 27B (13.1 GB VRAM)
Ahahah, thank you.

Yes, I'm not a native English speaker, and I'm definitely not an AI. ;)

I can't say the same thing because I just don't notice typos (mine or others).j I just assume my English is bad.

Isn't the definition of "being human" is "not to be perfect"? In French, it kinda is. We say "He/she humain after all" to mean that someone made a mistake.

_ache_··on Shapelearn Qwen 3.8 27B (13.1 GB VRAM)
Ahahah :'D

Yes... I'm not english native. And definitively not an AI.

_ache_··on Qwen 3.8 Omni Flash
I know, but it's a good enough proxy.
_ache_··on Shapelearn Qwen 3.8 27B (13.1 GB VRAM)
From my own test. It's not faster than the unsloth model.

Disclarer: I'm unsing Vulkan on an AMD GC.

_ache_··on Qwen 3.8 Omni Flash
If the performances are comparable, and there is no evidence it's not.

in/out ($) Gemini : 1.5 / 9.0 | Qwen 3.8: 0.15 / 0.47

That is a massive cost reduction.

Refs: https://www.alibabacloud.com/help/en/model-studio/model-pric... https://runware.ai/gemini-omni

_ache_··on Qwen 3.8 Omni Flash
I don't think Qwen3.8-Omni-X will ever be released.

The last one was: Qwen3-Omni-30B-A3B https://huggingface.co/Qwen/Qwen3-Omni-30B-A3B-Instruct

And maybe Qwen4 won't be released, they only release Qwen3.8 27B (and a mostly unusable 125B). There are definitively slowing down open weight release.

_ache_··on Mistral X Mozilla: Private, Multilingual AI Browsing
The strategies of Google and Apple, regarding how to provide a LLM, seam to disagree with you. Gemini run on a potato and Apple is local first.

So, you may actually have very good performance with local model. Just not yet on *every* device. So the Mozilla strategy here feel very reasonable. A Cloud provider specialised in local models, to be able to switch once local models will be quick enough on most devices.

Page 1 of 14Next →