HNHacker News
TopNewBestAskShowJobs

bigyabai

3,314 karma · joined May 8, 2024

submissionscomments
bigyabai··on US voters roundly reject data centers in ballot measures
The preliminary economic assessments agree; AI has not produced generally higher productivity, higher profit margins or growth boosts: https://www.apollo.com/wealth/insights-news/insights/daily-s...
bigyabai··on 512GB Mac Studio
Both. Apple Silicon could have the best of both worlds if it supported dGPU/eGPU tech, but Apple depreciated that about a decade ago. So you're stuck with fast RAM and a slow GPU.
bigyabai··on Nvidia RTX Spark encrypted firmware slows inference speed to 35% on Linux
These aren't "other product lines" though. They are RTX and Spark SOC products that do support Linux as a first-class citizen with all of their hardware. The RTX Spark is the outlier, and the breakage is not on the GPU product, but the SOC devicetree drivers. This is only a problem because Nvidia avoided standard Windows power management a-la ACPI/UEFI, and has to port the remainder to Linux by hand. Non-laptop products like the DGX Spark support this via UEFI natively.

There are OEMs that refuse this responsibility. If that's the vindication you wanted, there you go. This specific issue is not a catastrophic oversight though.

bigyabai··on Trump Accounts to Get SpaceX Shares from Shotwell in December
Elon Musk had several months to do that at DOGE, and my taxes are still the same.

His conflict of interests is not a gift to the American people. We all know that, now.

bigyabai··on Yassamin Ansari: Top of the Democratic agenda on day 1 pause on advanced AI dev
It's not completely pointless. America's "closed" labs have no moat. US taxpayer money should not bail out these businesses.

The "superintelligence will kill us all" shtick is definitely ridiculous, but it's not the only angle worth considering. From a zoomed-out perspective, there are lots of pragmatic reasons to diversify the economy away from AI development.

bigyabai··on Nvidia RTX Spark encrypted firmware slows inference speed to 35% on Linux
> Do they also need to support MacOS, Chrome OS, and FreeBSD?

They basically do. ChromeOS runs a Linux kernel, so the userland has everything it needs to run CUDA. FreeBSD is a first-class target for Nvidia drivers, and macOS used to be supported too but stopped signing Nvidia code. Nevertheless, AArch64 is still supported for CUDA et. al..

It is up to Nvidia to support whatever platforms they want users to be on. In their case, it means supporting many OSes.

bigyabai··on macOS 27 does not support CoreStorage volumes
Can you imagine if people said this about political catastrophe?

"Yes, war with Iran has been threatened many times but we can rest assured it will never happen because nobody has done it before."

bigyabai··on Nvidia RTX Spark encrypted firmware slows inference speed to 35% on Linux
And people keep coming back. Myself included; there's no similar GPU products from AMD, Apple or Intel.

Nvidia won because their architecture is better. If you do a significant amount of work that can be CUDA-accelerated, you're kinda wasting your time not owning a CUDA-capable card. It's like being a video editor that software-encodes their projects because they don't want to get an accelerator card. It's your choice, but software-acceleration is a nightmare compared to how quick and efficient hardware-acceleration is. Competitors will all use the accelerator card and ship faster than you can.

Apple, AMD and Intel have all earned their current position by abandoning Khronos and refusing to build their own GPGPU architecture. If the entire industry refuses to invest in complex technology just because it's expensive, then they don't deserve to make money.

bigyabai··on Nvidia RTX Spark encrypted firmware slows inference speed to 35% on Linux
That was also my reaction to reading this. I closed the page when it became apparent the author had no idea what they were doing.
bigyabai··on 512GB Mac Studio
GLM-5.3 would be bottlenecked by the M5's GPU, here. I don't have any hard numbers, but Apple Silicon is known for weak prefill performance on larger models (yes, even MoEs).
bigyabai··on Intel stock collapse worsens as $3.5T chip rout spreads
Feel free to write a full response when you get the time.
bigyabai··on European RISC-V Industrial Computing Initiative
ARM is a markedly worse choice than RISC-V for Europe. It's expensive to license, relatively inflexible, and not majority-owned by European firms.

There is no tangible advantage to Europe adopting the ARM ISA for domestic chips at any scale.

bigyabai··on Intel stock collapse worsens as $3.5T chip rout spreads
> At data center scale that is not something shrugged off

Sure it is. At datacenter scale, there are precisely zero HPC vendors that have invested in Apple Silicon as an alternative to Ampere or Grace CPUs. Same goes for datacenters seeking to replace their Intel CPUs. Chips like the M-series are explicitly nonviable for Xeon-scale use cases.

bigyabai··on Apple reports fourth quarter results
> I mean frontier like ability with less data.

But why would you need an ASIC for that? If you can get frontier-like models into "less data" footprints, just use the GPU.

You don't need redundant memory systems to make it work. No model has to be (or should be!) "baked into" the Apple Silicon SOC.

bigyabai··on Postman silently auto-installs AI plugins and attempts to share all API data
UNIX is, UNIX-y stuff isn't.
bigyabai··on Open-source "codes of conduct" are cancer and need to be retired
If this post was a PR in any Open Source project, it would be closed and ignored in almost 100% of them. Same if it was a Jira ticket at work. Why wouldn't it be?

Well-defined governance policies stop businesses and orgs from wasting their valuable time on zero-sum politics like this. If he doesn't agree, he doesn't have to participate.

bigyabai··on Open-source "codes of conduct" are cancer and need to be retired
Calling benign anti-harassment policies "cancer" is why they exist in the first place.

It makes me wonder what these people think workplace decorum looks like in professional orgs. It's not a free-for-all.

bigyabai··on BYD sold more EVs last month than the US did all quarter
That sounds quite reminiscent of America's auto industry, as well as the desktop computer, smartphone, web search, AI, fast food and supermarket industries too.

Man, China's been taking notes.

bigyabai··on Apple reports fourth quarter results
Instead of feeling insulted, you should just refute me. Why are ASICs a desirable alternative to GPU/NPU inference here?

The "baked-in" weight technology you are describing uses enormous amounts of memory. There is not enough SRAM or flash ROM in the world to put a "modern frontier model" on every iPhone, even if you quantized it to 1 bit. It is scarce and expensive, and we are in a global shortage of memory and flash storage.

If we lived in a world where Cerebras, Taalas and Groq could dethrone Nvidia, they would have done it years ago. Turns out, cutting architectural corners has consequences, and they're extremely offputting for the majority of inference providers.

bigyabai··on Musk is throttling Grok because its cost is 'unsustainably high'
Just like how Chris Poole sold 4chan to the Mossad, I think Elon's goal here is to just sell the CIA control over X. Profitability be damned.

It'll be popular forever now, not because of momentum or network effects, but because fake engagement and bot content will be blended in with genuine user generated content. People too easily forget that TikTok was a national security concern, and that there was almost certainly secret/sealed imperatives to build a comparable US platform with equivalent international outreach. Well, here you have it.

bigyabai··on Apple reports fourth quarter results
> until iPhone 21 ships with then modern frontier model baked into Apple Silicon.

Citation: It Came To Me In A Dream

bigyabai··on BYD sold more EVs last month than the US did all quarter
Because China has a surplus of batteries, electric motors, ICs and microcontrollers?

If it isn't, it's certainly an advantage over the trashy EVs we have in America.

bigyabai··on Oracle files to sell $20B in new stock, bonds to finance AI buildout
On strictly business terms, you're absolutely correct. Considering that OpenAI and Oracle both eat from Trump's hand though, I think that Larry Ellison has a few tricks up his sleeve to remain a "necessary" contractor. This is probably a shorter-term investment to pad out the coffers 5-10 years from now.

If rampant despotism is the end-goal, Oracle has already aligned themselves with the despots.

bigyabai··on It wasn't AI that flipped Proton's charge
> I do wonder who would be demanding that Proton move faster.

Whenever I see "hosted in Switzerland" my mind immediately goes to the Crypto AG scandal.

bigyabai··on US tech stocks see sharp falls over AI cost fears
Optane wasn't DRAM; that was literally the whole point of it's existence. Intel hasn't proven that they can make DDR4 let alone LPDDR5 or GDDR, and even if they did it wouldn't have helped produce Arc GPU chips since they were supply-constrained by TSMC.

Intel could have piles of GDDR sitting around, and Arc GPUs would still be have limited supply. It's just the way the product was made.

bigyabai··on Google Search is now less than half of Alphabet’s revenue
Webkit was forked from KHTML. Nobody "invented" Webkit.
bigyabai··on I went to Mexico to test-drive the cars Americans can’t buy
> no need for American car industry to be decimated

You are about 4 decades too late for that to matter.

bigyabai··on Police chief unplugs cameras after Flock ignores contract cancellation
> Why do we let narcissists run so much of our world?

Flock's shareholders and board of directors don't pay their executives to be humanitarian moralists. Same for OpenAI, Disney, Apple, et. al.

bigyabai··on US tech stocks see sharp falls over AI cost fears
> It when will the past become good enough for daily use?

We should all know by now that it depends on who you are. For conversational use, toolcalling and structured response, it was a few years ago. For coding it will probably be a few months from now. And for advanced 3D/computer use/biology/engineering applications, we're probably looking at a longer time horizon.

We have GPUs and NPUs capable of accelerating models this size on-device, most of the time. Replacing that flexible logic block with a static ASIC is a downgrade, especially since users don't ever have 1000+ tok/s or batched request requirements. The on-device acceleration is perfectly fine for >8B model inference.

I get that people are starry-eyed, and that HN is supposed to be the place for curious inquiry. But creating a coprocessor that uses a redundant, static memory system that gives users no noticeable advantages is much more expensive and stupid than investing in a CUDA-style GPGPU architecture.

bigyabai··on Anthropic takes steps to block Claude from reverse-engineering video games
Also from Anthropic:

> Like Claude Mythos Preview, GLM-5.3 has strong capabilities for autonomously building end-to-end cyber exploits. But GLM-5.3 is unlike other frontier models in that it has been released without meaningful safeguards to limit misuse. https://www.anthropic.com/research/glm-5-3-and-the-spread-of...

Just sayin'...

← PreviousPage 4 of 34Next →