RandyOrion

At least student movement succeeded in an authoritarian / totalitarian country. The movement was a dangerous move and can be fatal. Please remember that in 1989, Chinese students and workers protested in Tienanmen Square, and got massacred and failed.

At least this parliament is elected by people, not manipulated by a corrupted authoritarian / totalitarian party or such.

At least Serbia society can get a chance to rest or recovery after a lot of destruction happened.

Wish them the best.

I'm aware that long-lasting reverse engineering efforts on nvidia gpus, like cmp gpus, will lead to something impactful. I just didn't see it clearly until your project came out. Good job on that.

For now, I think reverse engineering efforts on 50 series gpus are just beginning. There are projects like reading sensor temperatures directly from the gpu itself instead of using deliberately DOWNGRADED software like nvidia-smi. However, I don't really see these efforts spreading, and people behind them really needs more recognition. Props to these people, too.

As a person who uses consumer level hardware to do neural network research, this unlock is truly INVALUABLE.

This unlock is super useful as it improves the GPU performance on computation-bounded neural network workloads like LLM prefilling, image/video generation, and general neural network training, in a way of disabling deliberate software segmentation on the same hardware imposed by Nvidia.

I'm on rtx 50 series, and no free performance uplifting for now. Waiting for more reverse engineering efforts to reveal whether the unlock is possible for 50 series.

In China, at least 100 million retired people with rural Hukou (户口) can only get 100-300 CNY (or ~15-45 USD) pension per month from the government. Note that they just pay their taxes like everyone else. That's why raising children so they can help you when you're old (养儿防老) is so wide spreading in rural China.

Ask me how I know this? Most (99.999999%) people in China do not have the freedom to express themselves online safely. You meet them and ask them personally to know this kind of thing exists. Then you check the statistics from Chinese government about pension distribution, retired people with rural Hukou get the most discrimination from the government.

I just want to note that Vadim Sokolov and Shiva Maharaj do show up as coauthors of these papers. See comment section in this page [1].

[1] https://statmodeling.stat.columbia.edu/2026/08/27/258

Hilarious. My first thought on these fonts is that similar clip art style text is frequently used in Persona 5. Now I know this is an active design choice.

P.S. I saw keming and my mind went blank for a little while.

No.

The 996 working culture in this page is actually *996.ICU*. "Work by '996', sick in ICU", an ironic saying among Chinese developers, which means that by following the "996" work schedule (9 am to 9 pm, six days a week), you are risking yourself getting into the ICU (Intensive Care Unit). [1]

Take a step further, do you want to overwork to death if you have other choices? One of the reasons behind 277k stars in 996.icu repo is that 996 working culture literally takes over every single corporations in China. With the downturn of China economy and the selective execution of Chinese labor law, in recent years, 996 becomes even harsher to labor force in China because there are more than overwork now, e.g. low salary and low human rights. When you say 'make the average consumer better off', you conveniently ignore the tears, sweets, and blood behind the facade of neijuan.

[1] https://github.com/996icu/996.ICU

> I was shown a prompt and told the internal research model had simply been given the problem statement. Levent had been told by Sebastien “very little human input” had been used. This turned out not to be true. Over the course of the call, as members of their team sent Sebastien corrections and details over their internal chat, it emerged that an entire team had been working on the problem, that this was one of a number of things that was tried, that work had started on the unforced problem, that the team first set the model on easier problems, including Euler, that even the prompt that had been shown to me had been written by prompting Codex, and that an insane amount of compute had been used.

> I asked when the first prompt had been sent by them. This question was not answered directly by OpenAI for some time. Eventually it was agreed that it had been sent in the past few days, after information about our work had reached OpenAI.

> I asked whether the model had been trained on, or had access to, our sessions in Codex, into which we had been putting all our drafts for the whole of this project. I was told the model did not look up user data. I asked again, about training, and I did not get an answer.

> Two proposals were offered to me. The first was that we post our Euler result, and that OpenAI post its Navier-Stokes result the next day. The second was that, after posting Euler, I alone write a paper presenting the Navier-Stokes result, acknowledging that an internal OpenAI model had resolved it. Sebastien twice asserted that he wanted Levent removed from authorship, and said it would all be simple if only it were not the case that, and it was so annoying that, Levent works at Anthropic. It was also said that if OpenAI posted after us, they would say that we deserved the Clay Prize, and that we were the “closest humans to the problem”. I declined both offers.

> I said that if OpenAI released its result in the way proposed I would go public with what happened. The reply was, “Why would you ruin your career?” I replied that I am an academic, and asked why he thought going public would ruin my career. The reply was, “If you don’t want me to be nice, then I don’t have to be nice.”

Wow, that's some VERY friendly communication. Besides, will the career of the person be ruined because of “Why would you ruin your career?” came out of his or her own mouth?

Good to see new open source/weight LLM families. Waiting for the final release of https://huggingface.co/IFM/K2-Horizon-32B .

In contrast to memory-bounded autoregressive decoding, diffusion decoding can be computation-bounded. Devices with a decent amount of compute but very small memory, e.g. nvidia consumer-grade GPUs, could benefit from diffusion decoding massively.

Performance-wise, I don't think diffusion decoding should be much worse than autoregressive decoding, see https://arxiv.org/html/2604.11035 .

As a local LLM user, I really want to see more small diffusion LLM/VLMs with decent performance coming.

Thank you Qwen team for this release.

Compared to closed weight (especially unreleased and access-limited) and open weight/source large sparse MoE LLMs/VLMs, open weight/source small dense models benefits public the most because they just reaches more people.

Compared to Qwen 3.6, 3.8's thinking style changed drastically. With xhigh budget, it thinks a lot MORE, and longer thinking session directly translates to better performance. This tradeoff between performance and computation, memory, etc. is meaningful to me.

However, because Qwen 3.6 and 3.8 share the same architecture, with 32GB vram, llama.cpp, IQ4_XS model, MTP and FP16 mmproj, I can only get 200k context, which is not good compared to 640k context of muse glimmer. Hopefully this problem will be solved in Qwen 4.0 release.

Thanks Bonsai team.

Now open weight LLMs/VLMs/LMMs are becoming even larger to the extent that consumer-grade hardware are no longer able to run these models. In contrast, quantization and pruning make the model better at the size-performance pareto and provide people with strictly more possibilities.

Other details for the official (Yang Youlin) in this news.

---

Whistleblower Yang Hai already reported Yang Youlin for his economic misconduct in July 2008. The whistleblower was detained because of the report at Nov 21st, 2008.

---

People's comment on this matter around March, 2009:

哇塞！终于有人敢动杨友林啦，杨海好样的。杨友林此人早该除无奈碍于他的势力。除掉杨友林大快人心。Wow! Finally, someone dares to take action against Yang Youlin. Good job, Yang Hai. That guy should have been dealt with long ago, but we were stuck with his influence. Getting rid of him is incredibly satisfying.

不杀此贪官，难平民愤。If you don't execute this corrupt official, you won't appease the public's anger.

江宁有一个传说，谁也动不了杨永林！There's a legend in Jiangning: nobody can touch Yang Youlin!

他的保护伞是谁？Who is protecting him?

希望引起中央的重视！I hope this gets the attention of the central government!

现在社会怎么啦？好多天了根本没人关注这件事？是上层没有看到？还是视而不见？还是怕牵连自己？What's going on with society lately? It's been days and no one is paying attention to this! Did the higher-ups miss it? Are they turning a blind eye? Or are they just afraid of getting dragged into it?

---

Since the report, there were several pieces of news about "the investigation about Yang Youlin is ongoing", but no real progress until 2023.

The criminal complaint missing in this article: https://www.justice.gov/usao-ndil/media/1450651/dl

Basically, Microsoft logs things from windows users, including and not limiting to, the machine GDID, IPs that come with the GDID, and when and what exact URLs accessed. So for windows users, privacy, an important part of information security, is totally destroyed by these logs enforced on windows. Another important part of information security is bug fixing, and microsoft did make at least one security researcher angry [1].

And a simple solution to that problem is moving to linux. You save yourself a lot of time and energy for leaving the adversarial information security condition imposed by windows and microsoft.

P.S. You may consider debloating windows for a more information security friendly environment. However, that is nearly impossible, as long as you realize that windows is an OS composed of thousands of closed source softwares, and doing security audits on all of these will be costly.

[1] https://news.ycombinator.com/item?id=48315968

Yeah, searxng instance reliability problem goes deeper than simple uptime. The google response time function on public instance page [1], a good measure of the search engine availability of one instance, is broken for some time. Without real testing, people really cannot get the full view of the service status of a single instance.

[1] https://searx.space

I've been using searxng for several years now. I don't run my own instances because the inhumane network censorship imposed by GFW, and proxy detection enforced by search engines. Instead, I rely on public instances on the list [1] and libredirect [2]. Note that service from a single instance is not guaranteed, but you can always switch to other available instances with little cost within a minute.

I won't say searxng can help you degoogle because metasearch engine calls other search engines, e.g., google, to collect results. However, if you try searxng, you can at least get rid of things like ai reviews in no time.

In the end, thank you people after searxng project and public instances.

[1] https://searx.space

[2] https://github.com/libredirect/browser_extension

Android developer verification program, together with recent reCAPTCHA push [1], and Manifest v2 force depreciation on chrome [2], make one thing crystal clear. When companies like GOOGLE talks about things in the name of "your security", it's a sign that they want you to sacrifice your own things, e.g., privacy, freedom, etc., for their own security. And if you trust them and show your consent by doing nothing, you pay the price.

[1] https://news.ycombinator.com/item?id=48067119

[2] https://news.ycombinator.com/item?id=48555244

Glad to see more open models. However, where are the 31b models?

I've been using FUTO voice input for several month. It's not perfect as I have to manually do the correction like always. However, it definitely saves me some time and effort. It also helps me to degoogle, starting from gboard.

Apparently this new swipe function is tied to FUTO keyboard. I don't use the FUTO keyboard as there is no support for the language I use intensively. Nevertheless, this line of work deserves more recognition.

We paid for your things, AMD.

If you want to strip some features from things we bought after the purchasing, you must ask me and every other customers for consents explicitly, with a reasonable explanation, and before the strip happens. If one of us show no consent, you cannot do that.

-------------

See the github issue [1]. @benkilpatrick found out the problem in April. There was absolutely no consent asking information transparency at all. There was inefficient to no information even for people willing to spend THEIR OWN TIME to solve the problem. After about two months of back and forth with motherboard manufacturer, @benkilpatrick found out the problem stems from some components inside the bios, and the components came from AMD. Another ~three weeks passed and no problem resolution at all. It was after things blow up AMD PR came out and said something about "valuable feedback".

Wait, what if there's no enough pushback? What if this github issue as well as the problem it raised is ignored by all? Just see this thread, that thread [2] and whatnot. Is your customers going to screw themselves and being stripped silently for being your customers and believing that new bios will solve their problems without causing shenanigans?

-------------

I won't upgrade bios without future third-party bios integrity checks showing the problem is solved properly.

[1] https://github.com/AMDESE/AMDSEV/issues/292

[2] https://news.ycombinator.com/item?id=48582320

To people who silently downvoted this: please explain why you did that, you're doing things like AMD.

The github issue that never made it in this news: https://github.com/AMDESE/AMDSEV/issues/292

Silent enshittification in the name of updates is getting out of hand. There are several evidences that downgrading BIOS/AGESA to below 1.2.7.0 to 1.2.0.3 brought back TSME for their AMD cpus.

I downgrade my bios as a price for my blind trust on AMD, and yes TSME is back.

You lost my trust AMD. The lesson learned is that if your PC with AMD cpu is stable, don't do any bios upgrade, as AGESA in the bios is adversarial to you, the users of AMD cpu.

Seems like the affected version of chrome is 150 and 151, and the timewindow is near.

Because of ungoogled-chromium, I'm used to manually update the browser. This time I won't update until MV2 problem is solved properly. I've already lost my extensions once by updating to 138 without checking google's adversarial move, and got the forbidden knowledge that I cannot manually downgrade chromium because it won't start.

Please do not claim you trained a new model, only to got caught red-handed by others. There are already several people or groups did that, got caught, and vanished in no time.

Check how the "authors" of "this model" react to this problem [1]. See how they deal with this problem by first changing their affiliation from https://iplanrio.rio.rj.gov.br to https://iplanrio.prefeitura.rio [2], then saying that they are sorry for being caught [3], then just remove all their affiliations once for all [4].

I think the "authors" of "this model" [5] should be held accountable until they upload new checkpoints, and the performance of the new model is verified by third-parties.

P.S. To people who downvoted me, show me why you're doing this.

[1] https://huggingface.co/prefeitura-rio/Rio-3.5-Open-397B/comm...

[2] https://huggingface.co/prefeitura-rio/Rio-3.5-Open-397B/comm...

[3] https://huggingface.co/prefeitura-rio/Rio-3.5-Open-397B/comm...

[4] https://huggingface.co/prefeitura-rio/Rio-3.5-Open-397B/comm...

[5] https://huggingface.co/prefeitura-rio

I don't know how open source AI wins. The description is too vague for serious discussions. What I do know is that, once closed source AI groups become anti-you, you should punish them, or help open source groups, or both.

If you really want specific open source {LLM, LMM, research, harness, whatever} groups to win over closed source counterparts, you may show your care by trying open source solutions first when solving problems. And if they're really capable, award them with contributions or something.

Hilarious read. I laugh out loud multiple times during the read. In the end, I think amd should pay the author simply for the will of debugging for a broken software written by amd, as well as the sheer amounts of loose ends this exploration leads to.

Thanks gemma team for this release.

Compared to autoregressive decoding, diffusion is huge for local MoE inference because of the improved token generation efficiency, especially for normal GPU + ram offload setting.

However, there are models which are better positioned on the performance vs memory pareto front, i.e. dense models, so I'll just wait.

P.S. QAT is really something as it reduces the performance fluctuations compared to the normal one. Thanks again.

More rants about local inference, consider yourself warned.

Together with bf16 related deliberate hardward degrades on consumer-level nvidia gpus, i.e., gtx 10, rtx 20, 30, 40, 50 series, things gets sour really quickly.

From the perspective of a local llm user, I think the qat doesn't solve the major problem of the gemma models.

Gemma family (gen 1 to gen 4) is consistent with extreme range of activations, i.e., 600000, essentially forcing people to use bf16 kv cache and accept a short context window, e.g., 31b, iq4_xs quantization, 100k context window on 32gb memory. Or, people use q8 kv cache, 200k context window, and accept a large performance penalty.

In contrast, for qwen 3.5 family, the largest activation is below 2000, making q8 or even lower-precision kv cache essentially free estates. Together with linear attention, which doesn't require kv cache, full 262k context window can be easily reached.

Qat training with w4a16 target, while improving performance on inference with low-precision weighs, doesn't solve kv cache problem at all.

In the end, a qat is a qat, and there are unseen efforts behind qat checkpoints. Thank you gemma team for releasing qat checkpoints.

A small dense multimodal model with audio support, interesting.

Wait, *Excluding Chinese language.

This is ... curious.

P.S. Where is gemma 4 124b?