HNHacker News
TopNewBestAskShowJobs

stevefan1999

2,192 karma · joined July 1, 2017

submissionscomments
stevefan1999··on AMD's Instinct MI455X: Aiming for the Sun
That only works if you have all the unit tests and making sure the behaviors between different GPUs are expected, and can tolerate difference in implementation details such as numerical stability and complexity for some functions. AMD and Nvidia are doing vastly different computation for different implementation to the same algorithm for their APIs (can't tell due to NDA, but one algorithm Nvidia did it using broadcast, while AMD is using tile), and that's one of the reason I gave up. And perhaps only for light kernels doing basic BLAS operations and GEMMs. With a standard to follow, that's one of places where it indeed is giving it a good chance, for example on Tensorflow with ROCm or PyTorch. You basically have an insurance of the behavior and a translation layer for ROCm and CUDA by Python.

But anything other than that, nah.

Edit: Maybe I remember what algorithm that is. It is a trick to do coding theory stuff by using NTT (Number Theoretic Transform, the friend of DFT, the Discrete Fourier Transform, but on a ring and hence applicable to finite field) on GPU to do computation over a GF(2^8) field, for my former employment but I went back to using GFNI. Still I have a NDA to adhere to and can't really explain what happens.

stevefan1999··on Buz – A fork of Bun using modern Zig, with sub-1s incremental builds
I rather replace bun with deno, given that now both bun and deno are written in Rust, and Deno have even more node compatibility than bun. Deno and Node both runs on V8, while Bun runs on JSC, and Deno has a killer feature that you don't have to even run npm install to use package, you can just top-level import or await import an URL (given that you allowed it with a command prompt or bypass it competely with -A but discouraged).

I've used Deno, CucumberJS and Playwright to write E2E test suites. Zero npm install and not even deno.json or package.json

stevefan1999··on AMD's Instinct MI455X: Aiming for the Sun
but you have to rewrite all your software to ROCm. And ROCm, to this day, still sucks.

ZLUDA basically crash on high memory demand, and only accounted for ~70% of CUDA API coverage (and it is still buggy).

But hey, at least it does run on Rust-CUDA. I'm one of the few who ported it and fixed a few bugs on ZLUDA. I used it to run a simple SHA256 kernel and it ran sure, but I gave it up because of those fundamental problems on AMD GPUs. You can't believe how messy ROCm is. I wonder if Vulkan compute kernel using SPIR-V would be a better choice.

stevefan1999··on It's getting harder to focus every day
Perhaps we should learn from the ADHDs on how to resist the dopamine hacks.

Oh wait, I am one and I can't resist it since day 1 on this world.

stevefan1999··on Why Software Factories Fail (or: harness engineering is not enough)
Or fuck them, fuck the managers, fuck the c-suites (intentionally decapitalized), go for a flat organizational structure like Valve where you have no one to report to (well maybe Gabe Newell or the team leader for that project occasionally), but the culture is that everyone can manage themselves organically rather than having hierarchies and forced, useless reportings
stevefan1999··on Show HN: Echo – Fable-level results at 1/3 the cost using open-weight models
So it is a mixture of models, then each model have a mixture of experts, making it mixture of mixture of experts...why don't we just make it simple and have a central expert router made up of random forest...all we need some kind of actor system to share the gradients of the experts...and ensemble it
stevefan1999··on Fable 5 vs. GPT-5.6 Sol on an NP-Hard Problem: Does /goal help?
Because my instinct immediately went into simulated annealing or ant colony.

Or I think my PTSD on advanced algorithm course kicked in

Edit: looks like the closet reduction should be https://en.wikipedia.org/wiki/Ring_star_problem with bounded circuit length

stevefan1999··on Fable 5 vs. GPT-5.6 Sol on an NP-Hard Problem: Does /goal help?
...is this not a Travelling Salesman Problem?
stevefan1999··on Shipping OpenStrike: A Counter-Strike-Shaped FPS on a 2004 Handheld
Well but https://github.com/Velaron/cs16-client exists...
stevefan1999··on Static search trees: 40x faster than binary search (2024)
My first instinct is https://en.wikipedia.org/wiki/Van_Emde_Boas_tree

Not sure why

stevefan1999··on Kimi K3: Open Frontier Intelligence
Oracle is fine, it's just that they can't really expect political decisions that hindered it to accquire TikTok which will be slated to be the biggest customer if the deal went through.

Now they are betting with Project Stargate but it also seems to be crumbling down.

But don't forget that they literally hold the biggest databases, both in commercial and open source, that is, Oracle Database and MySQL. Plus Oracle Java they literally controls at least 30% of the internet's software infrastructure.

And also with a good team of attorneies enforcing the licenses, they can squeeze so much money at the cost of morality.

Also recently they downgraded the always free OCI ARM instance from 4C24G to 2C12G without telling anyone.

stevefan1999··on Japan develops a method to recover up to 90% of lithium from used EV batteries
So long or short Lithium?
stevefan1999··on It's not about physical vs. digital games, it's about ownership
That's corpo-technofeudalism, it is unfortunately on the rise. They want to get rid of your control and opinion and strip your freedom away, forever enslaved to their system and pay rents In some sense it is comparable to religions but under different corpo-warbanner
stevefan1999··on It's not about physical vs. digital games, it's about ownership
I would argue further: it's not just about ownership only, but about control on a different level, that the industry can dictate what you can play by mass revoking the license, in order to force a next "hype" by getting rid of your independence.
stevefan1999··on A C++ implementation of a fast hash map and hash set using hopscotch hashing
I learned C++ because of it, what's so shame about it?
stevefan1999··on Working around dragons with the Lemote Yeeloong laptop and OpenBSD
I still think it is very cursed to see that image of RMS using that laptop despite I was shocked to see it 12 years ago. Still shocks me to this day.
stevefan1999··on A C++ implementation of a fast hash map and hash set using hopscotch hashing
Ah, hopscotch hash, I tried using it on my CSGO cheat literally 10 years ago, for the object reflection (retrospection) system based on compiler type ID and unique hashing scheme with function signature. I merely used it for hopefully getting a performance on the "dependency injection" side of things, until I realized it is actually a service locator pattern and performance won't improve due to this architecture anyway.

It was 3 years later when I was in college I learned advanced data structures and came into Cuckoo Hashing, then Robinhood hash, and the combination of both Cuckoo and Robinhood hash => Hopscotch hashing

stevefan1999··on Show HN: Bible as RAG Database
just how far are we from the machine god in the Warhammer 40K universe
stevefan1999··on The truth about being a manager
That's why I rather want to have LLM as my manager and not the other way around. Having a middleman is worse than having none.
stevefan1999··on Running MicroVMs in Proxmox VE, the Easy Way
I wonder if https://katacontainers.io/ would be a nice competitor
stevefan1999··on VPN ban update for UK households as government looks at 'age-gate'
A large chunk of them is from China :p
stevefan1999··on AURpocalypse now: a look at the recent AUR attacks
Well all of those attacks are just supply chain attacks, and it is basically exploiting people's trust. With LLMs, the speed and velocity of pumping out malice raised are now significantly faster.

It is so sad that every goodwill eventually got enshittified as well.

stevefan1999··on Cell-based architecture for resilient payment systems
Backing up would be hell
stevefan1999··on Image Compression
I still remember the multimedia course...DCT, JPEG and all the compression algorithms like Huffman coding and Arithmetic coding...
stevefan1999··on Lore – Open source version control system designed for scalability
That's by design of git, you can't forget that git is first developed for a bazaar model of information flow, especially with a big decentrailized project like the Linux Kernel, not the silo and isolated corporate NDA and closed model you described. Git prefers open information and discourages information closures and segregation of information by placing restrictions exactly like this.

Git enthusiast would often tell you to do this separately with a submodule, and set permission on the version control forge software level (which means Gitea/Github private RBAC access to certain repos for cloning), sure, but that is also painful as hell.

But my point is that all of this is exactly by design from Linus Torvalds's need for Linux Kernel to replace BitKeeper. Git simply isn't the tool for everything, it was developed for a software project with liberalism in mind, but corporate stuff is monoculture and prefers proprietary, shut-in model, and the eat your own dog food mindset, and no wonder it is so painful to deal with.

stevefan1999··on TIL: You can make HTTP requests without curl using Bash /dev/TCP
Yep. I also learned that too when watching Bauhinia team members' using this to solve a CTF challenge :p It is a multi-series CTF that you get shell from first a ROP chain to system, but you are effectively jailed from running anything but bash, so the only thing you can use is read and cat, and they used the cat /dev/tcp, then redirected it to a pseudo-tty, and read the content of the pseudo-tty in order to get the URL to the inner system. The flag, there it is.
stevefan1999··on Feds freaked over Fable 5 after 'fix this code', not jailbreak, say researchers
Well, to be honest, from Anthropic's point of view this is really not a direct hit to their security barrier, but if we are using information theory and game theory here, this can be viewed as a classical, side chanel information leak, by asking an seemingly innocuous action, and then simply inverting the results to get the original information entropy, which the US Gov. and Pentagon are both certainly anal about.

The problem lies in the fact that the action of attack/defense exhitbits a rather special, structural reflexive duality of information, i.e. I(attack) = -I(defense), or in layman's term, what we call "two sides of the same coin": you need to know how to hit hard, so that you know where the optimistic hit points are, assuming the enemy is rational, so you can parry against the attack for defense, albeit also you need to know how to get the grip of the shield well.

And the worst thing is that if you're trying to correct it, it is basically tell the LLM not to give any kind of response, effectively assigning both I(attack) and I(defense) to 0, but this is also what kills the entire intent of using LLM to give you the magical answer.

To put it formally, you cannot prevent people from extracting mutual information of a dual system, unless you refuse to give any knowledge for that system at all.

stevefan1999··on Feds freaked over Fable 5 after 'fix this code', not jailbreak, say researchers
> If the guardrails can be bypassed at, say 50x token cost (due to the agent also pursuing things you don't care about), then it's still pretty effective as a safeguard

Economic factors doesn't matter to powerful entities such as rival corporations, enterprises, and state power. It only matters to small players who have limited budgets. But I have to also pessimistically assume that Anthropic would go this way, because 1. it does not prevents (you can NEVER prevent) but discourages using it for exploitation, and 2. Anthropic can on the other hand, exploit those small and legit entities by making you pay more, but in exchange effectively enshittifying it. But Anthropic could care two shits about the benefits of us normal, small person. Anthropic have all the motives to do this.

stevefan1999··on US Government directive to suspend access to Fable 5 and Mythos 5
Well, they also reset the quota
stevefan1999··on US Government directive to suspend access to Fable 5 and Mythos 5
So are you going to restrict access to Fable by another KYC scheme but this time prove that you are US citizen first amirite
← PreviousPage 4 of 31Next →