HNHacker News
TopNewBestAskShowJobs

ein0p

1,797 karma · joined February 11, 2024

submissionscomments
ein0p··on ZFS: Apple's new filesystem that wasn't (2016)
ZFS sort of moved inside the NVMe controller - it also checksums and scrubs things all the time, you just don't see it. This does not, however, support multi-device redundant storage, but that is not a concern for Apple - the vast majority of their devices have only one storage device.
ein0p··on GPU Price Tracker
Strange specs table - it seems to ignore the tensor core FLOPs, which is what you'd be using most of the time if you're interested in computational throughput.
ein0p··on Ask HN: Can vibe coding competitions be challenging and fair?
I think they can be, except of course the problems need to be much harder, and impossible to solve via vibe coding alone. Like it or not, AI assistance is going to stay with us. This is the "new baseline" against which engineers will be judged.
ein0p··on Mobygratis – Free Moby music to empower your creative projects
Hmm, generating royalty-free music on Suno, or getting involved with some pompous dude who strokes out at the sight of someone eating a burger and demands 51% for his "no strings attached" stuff that's 20 years old? Tough choice.
ein0p··on FBI arrests judge accused of helping man evade immigration authorities
I woke up to this in 2016 when theretofore beloved public figure Donald Trump turned into literally Hitler immediately after he descended down that elevator in the Trump tower, all without changing a single opinion he'd ever held. And it's been unrelenting ever since.
ein0p··on Lossless LLM compression for efficient GPU inference via dynamic-length float
At 192 cores you're way better off buying a Mac Studio, though.
ein0p··on Lossless LLM compression for efficient GPU inference via dynamic-length float
Thanks for chiming in! How do you explain the top-most graph in Figure 5? Am I misreading it?
ein0p··on Lossless LLM compression for efficient GPU inference via dynamic-length float
Did I say it wasn't? If your context is short and your model is small, it is possible to run LLMs on high-end CPUs able to support 12 channels of high-spec DDR5 RDIMMs. It's not possible to run them as fast as they'd run on a GPU equipped with HBM though. Nor would it be even remotely as energy efficient. Also, it's not possible to run LLMs quickly on CPU if your context is long, because CPUs do not have the requisite FLOPS to process long context quickly. And before you bring MoE into the conversation, MoE only affects the feedforward part of each transformer block, and full memory bandwidth and compute savings are only realized at batch size 1, sequence length 1, AKA the most inefficient mode that nobody other than Ollama users use in practice. Sequence length 8 (common for speculative decoding) could be using up to 8x37B parameters (assuming you want to run DeepSeek - the strongest available open weights model). Batch size of even 2 with sequence length 8 could use almost all parameters if you're particularly unlucky. Prompt will almost certainly use all parameters, and will slam into the FLOPS wall of your EPYC's ALUs. So can LLMs (with an emphasis on "Large") be run on CPUs? Yes. Are you going to have a good time running them this way? No.
ein0p··on Lossless LLM compression for efficient GPU inference via dynamic-length float
Note that this is _way_ slower at small batch sizes you'd need for interactive use. At batch size 1 this seems to run at 1/3rd the speed of bf16 (so about 1/6th the speed of fp8 you'd realistically be using) if figure 5 is to be believed. This is actually a pretty impressive feat in itself if you know anything about GPU kernel programming, but it is much slower nevertheless. For this to work at "wire speed" it'd need hardware support, which takes years. Their "baseline" elsewhere in the paper is CPU offloading, which is dog slow and can't be made fast due to PCIe bottleneck.
ein0p··on Exercise before bed is linked with disrupted sleep
Depends on what kind of exercise. A few heavy sets of barbell squats or deadlifts will put you out pretty good. Especially the deadlifts.
ein0p··on FBI arrests judge accused of helping man evade immigration authorities
A case study on media narrative peddling: https://www.koat.com/article/las-cruces-former-judge-allegat...

Original title: "Former New Mexico judge and wife arrested by ICE". It's as though he wasn't an active judge while harboring an alleged Tren De Aragua gang member.

Protip: believe absolutely nothing you read in mainstream news sources on any even remotely political topic. Read between the lines, sort of like people used to read Pravda in the Soviet Union.

ein0p··on Reproducibility project fails to validate dozens of biomedical studies
And all the drugs and treatments derived from those "studies" are going to continue to be prescribed for another couple of decades, much like they were cutting people up to "cure ulcers" long after it was proven that an antibiotic is all you really need to cure it. It took about a decade for that bulletproof, 100% reproducible study to make much of a difference in the field.
ein0p··on A $20k American-made electric pickup with no paint, no stereo, no screen
As far as I can tell, it's "$20K" the same way Cybertruck was "$39K". It's not available for purchase yet, and when it is, it'll be twice as much, because Bezos also likes money.
ein0p··on iOS 19 Rumored to Add Stage Manager Support to USB-C iPhones
Why though? Does anyone use it? I tried to use it on my iPad Pro and couldn't get used to it. This would make sense if some iPhone model was a tri-fold foldable with a huge screen, but I don't think that's going to happen in the foreseeable future.
ein0p··on DeepMind releases Lyria 2 music generation model
It's kinda like Suno, except Suno sounds pretty good sometimes. Even so, I played with Suno for a few days and lost interest. There are some amazing examples on Suno, though: https://suno.com/song/9a7fd58e-132c-4ac5-9a25-f40d7f6f8c9f. This is one of the early tunes, it probably can do better now.
ein0p··on When Does the US Government Become a Ponzi Scheme? (Micheal Burry)
We'll see about that, won't we. Printing $2T in an average year and paying $1T+ in interest _with borrowed money_ certainly does feel like a Ponzi scheme to me. No way out of this either, only collapse, further underscoring the ponzi-like properties of the system. The question is only when.
ein0p··on When Does the US Government Become a Ponzi Scheme? (Micheal Burry)
Printing arbitrary amounts of money on a whim without actually backing it with anything does undermine the solvency of the government, however. As we will discover within the next decade or two, once US dollar loses its reserve status.
ein0p··on On Not Carrying a Camera
I went the other way around. I carry my Z8 everywhere (in the backpack or on the strap), take it with me when I travel anywhere, and lately I've been shooting quite a bit of video with it as well. I started doing that when I realized how little I remember from just 5 years ago, and how helpful apps like Immich or Google Photos are with remembering the fleeting moments of my life. Could I do it with my iPhone? Yes. But I find that having a device that _only_ takes photos and videos makes things more intentional and less distracting.
ein0p··on When Does the US Government Become a Ponzi Scheme? (Micheal Burry)
I thought this was a settled issue: the date is August 15, 1971. This is the exact date the US Government became a Ponzi scheme. On August 15 1971 gold was $35 per troy ounce. Today it's 3342. Not to worry though, all other governments are Ponzi schemes, too. We do not need to run faster than the bear - only faster than the next guy.
ein0p··on Manufactured consensus on x.com
Looking at the comments, the blowback to this is pretty wonderful to see. There's hope for HN after all. More and more people are realizing that they don't have to blindly subscribe to the "current thing".
ein0p··on Subnanosecond Flash Memory
And then throw in some co-located compute there using chiplets, entirely bypassing the memory bus and PCIe. That'd be _the_ ideal Transformer substrate. Memory bandwidth bottleneck just disappears for the most part. Memory size bottleneck, too.
ein0p··on Google contract prevented Motorola from setting Perplexity as default assistant
Someone at Google should sic an llm at the trove of documents from the Microsoft antitrust trial. This is directly from the 90s Microsoft playbook. I'm sure I'm by far not the only one with a sufficient attention span to remember that.
ein0p··on Teaching LLMs how to solid model
Typically only the most powerful models are worth a try and even then they feel like they aren't capable enough. This is not surprising: to the best of my knowledge none of the current SOTA models was trained to reason about 3D geometry. With Grok there's just one model: Grok3. With OpenAI I used o1 and o3 (after o3 was released). With Google, the visual feedback was with Gemini Pro 2.5. Deepseek also serves only one model. Where there is a toggle (Grok and Deepseek), "thinking" was enabled.
ein0p··on Teaching LLMs how to solid model
I've done this, and printed actual models AIs generated. In my experience Grok does the best job with this - it one shots even the more elaborate designs (with thinking). Gemini often screws up, but it sometimes can (get this!) figure things out if you show it what the errors are, as a screenshot. This in particular gives me hope that some kind of RL loop can be built around this. OpenAI models screw up and can't fix the errors (common symptom: generate slightly different model with the same exact flaws). DeepSeek is about at the same level at OpenSCAD as OpenAI. I have not tried Claude.
ein0p··on PaulG on building the infrastructure of the police state
He's also not the only one doing it. Every time the Deep State needs to sneak in something particularly vile and avoid public scrutiny, we get "UFOs", or "directed energy weapons", or "Russian/Iranian/North Korean hackers" or something like that. "UFOs" have been used for this since the 60s. "Directed energy weapons"/"Cuban syndrome" - since the 90s. "Hackers" are more recent. Works like a charm.
ein0p··on Tesla Q1 2025 Update [pdf]
There are other videos trying to replicate some of this and thereby proving this is fake. Not the first time Rober lied about things either.
ein0p··on Tesla Q1 2025 Update [pdf]
Not needed. With sufficient compute 8 cameras are more than enough to build a reliable depth map.
ein0p··on Googler... ex-Googler
Women are hardcoded for lifestyle inflation. The moment you start reducing the standard of living, the woman departs for greener pastures.
ein0p··on The Future of Compute: Nvidia's Crown Is Slipping
I don't think they even wanted to be in the crypto mining market. They artificially hobbled their GPUs specifically so that they wouldn't perform well there.
ein0p··on A new form of verification on Bluesky
Do tell how I could get an "anonymous" credit or debit card - the only accepted payment methods.
Page 1 of 34Next →