HNHacker News
TopNewBestAskShowJobs

bwfan123

1,311 karma · joined December 10, 2024

submissionscomments
bwfan123··on Meta Muse Glimmer – open weights 30B local coding model
> It even comes pre-quantized and with a MTP/drafter model

Glad to see the extra engineering effort that went into creating this local model and making it run well on a consumer device. I use qwen3.5-coder, and am waiting to kick the tires on this one. I hate to say this, but kudos to Meta ! I hope apple and others follow suit and create similar local models for other use cases like audio, images and video that can run on a laptop.

bwfan123··on Meta Muse Glimmer – Open weights 30B local coding model
Just tested muse-glimmer:30b-mlx on my laptop. Works great although a bit slow.
bwfan123··on Intelligence Is Not the Main Bottleneck
> no matter how “intelligent” AI becomes, intelligence is often not the main bottleneck to things changing in the real world

A mathematician Terrence Tao said something similar in a recent talk [1]. That, intelligence is bottlenecked by human understanding. Say there is an alien that brings an alien book containing math humans havent seen before. Using said math is bottlenecked by humans comprehending it first.

[1] https://teorth.github.io/tao-web/slides/age-of-ai-icm-2026.p...

bwfan123··on Aristotle quotes on virtue, knowledge, and happiness
> entertain a thought without accepting it

Entertaining an idea is understanding it. And, there is some research to show that understanding an idea is believing it. Hence, understanding an idea and not believing it is very effortful.

[1] https://bear.warrington.ufl.edu/brenner/mar7588/Papers/gilbe...

bwfan123··on After Losses, Retail Investors Flock to 3x Leverage as 2x Product Are Restricted
If you are in a hole, dig deeper.
bwfan123··on DeepSeek V4 Flash on a Single AMD MI300X
I am curious if there has been work to remove experts from an open-weights model. The goal would be to reduce the size to be able to run on desktop GPUs without compromising quality. For a focused usecase - say coding, you dont need a model that knows world history. And, I am not talking about quantization. If it is possible to determine which experts are active for some usecases, and surgically remove the others.
bwfan123··on Why we write our own C and C++ inference engines
Take a look at the code. It is a conglomeration of python, rust, go, cpp etc. I was expecting lean C or C++ but all I see is a kitchen sink of code, the AI generated kind. No problem with that, but it is inconsistent with the messaging. I appreciate the intention behind this, but dont like the execution. My prediction is that this will enter the graveyard of ai generated git repos.

For open-source code to get adoption and support, the theory of its construction needs to be understood by humans because at the end of the day, some human will be responsible for its operation. I would call this the Terrence Tao principle: Output of AI is only as useful as how well it can be digested by humans.

bwfan123··on SQLite Critical CVEs or LLM Slop?
> Now, we all pay the consequence, to the tune of hundreds of thousands if not millions of dollars of wasted productivity from teams that have to deal with the resulting fall-out of this usage of “AI”.

Brandolini's principle in action. It takes 10 times more energy to refute BS than to generate it. A related analogy to computing: it is easy to generate propositions, but hard to test if a given proposition is satisfiable or not, which curiously ties to P vs NP.

bwfan123··on Cancelling Cursor
> how annoying it was to try to cancel Cursor

Add it to the enshittified software list.

bwfan123··on Cancelling Cursor
> After almost every update, Cursor decides it now boots into the "Agent" view by default. You switch back to the IDE, restart the app - and you're back in the Agent view again. And the setting that controls this is moved and renamed every time

This got to me as well and I am off cursor. They kept changing the UI/UX with each release which was frustrating. But, kudos to them for pioneering this space.

bwfan123··on Ten advances in mathematics and theoretical computer science
> Hacker News is no longer a web site of an elite

hah, sorry, we are plebs out here.

bwfan123··on DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis
Thanks for the input. Let me check it out.
bwfan123··on Situational Awareness down 67% in July in AI stock rout
> leveraged financial nukes inexperienced and FOMOed investors have assembled

A lot of debris waiting to happen in data-center debt for sure. The next several years are going to be interesting with more of these type of blowups. This is a canary in the ai-wreck coalmine.

bwfan123··on Situational Awareness down 67% in July in AI stock rout
> What could possibly go wrong

A barometer of the mania and one for the history books. A 23 year old wunder-kind publishes a 156 page prophesy with a catchy title which was lapped up by the silicon valley elite and funded to the tune of 10s of Billions. And, not sticking to his lane, the wunder-kind enters the finance world thinking his brilliance translates there too, and he was promptly taken to the woodshed by the wall street sharks.

bwfan123··on DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis
> Are you buying from a provider that isn't listed on open router already

I am using openrouter with zdr guardrail which routes to any provider that supposedly doesnt train on user data. I also use fireworks (directly, not via openrouter) which is a provider promising zdr and has a bunch of open weights models. My issue is that these zdr providers dont transparently disclose caching/tokens etc and so they end up being far more expensive than directly using DS.

bwfan123··on DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis
> They announced it already

I meant something I could download and run.

bwfan123··on Situational Awareness down 67% in July in AI stock rout
Deja-vu from dot-com. The tech-wreck had similar hedge-fund road-kill. Munder net-net fund comes to mind. A lot of hubris and leverage on a thesis that is not proven, and liquidity matters. Data-center debt will likely see similar debris in the next several years.
bwfan123··on DeepSeek-V4-Flash Update
> Undercut the US AI providers and wait them out

You could have said the same of linux - that it extinguished proprietary OSs at least for server usecases.

bwfan123··on DeepSeek V4 Flash 0731 Intelligence, Performance and Price Analysis
> For the Code Agent tasks among the public benchmarks above, DeepSeek-V4-Flash-0731 is evaluated with the minimal mode of DeepSeek Harness (to be released) as the agent framework

So, are they planning to announce an optimized coding agent harness as well ? DSv4 flash is a fantastic model, and my daily driver. With reasonix or pi, I can code all day long and pay a few pennies for it. No token anxiety. Whereas the same model with fireworks/openrouter, with zdr thrown in, token costs ratchet up with no explanation. Likely that the model is subsidized for gathering usage data. I am waiting for the day I can run this locally.

bwfan123··on Nvidia's $750B in Deals Reignite Circular AI Fears
I guess it gets bigger with each passing day. Tens of billions goes to Hundreds of billions.
bwfan123··on How is the Bun rewrite in Rust going?
> Not understanding to the core the software you wrote, is going to exploded in your face.

Short-termism at its peak. Code maintainers will learn the hard way how to set the boundaries between ai-generated code, and human maintainable code.

bwfan123··on AI companies are shredding rare books
There needs to be wider reporting of this if it is true. Where are the journalists ? If this is true, it is scorched earth on the world's knowledge base. And the business models are not proven yet. I can now see why some ai companies paints a dire picture of the future - they are basically annihilating all knowledge sources at the altar of their ai gods. I can also see why there is growing ai-skepticism.
bwfan123··on OpenAI’s accidental attack against Hugging Face is science fiction that happened
> Well its clearly a stunt. If it wasnt we would probably be up to our ears in technical detail.

LLMs are the script kiddies of the day.

bwfan123··on Can Chinese AI (Kimi K3) file American tax returns (TaxCalcBench)?
Tax codes are a great example of something changing frequently, and something very nuanced. So, the training data doesnt exist for a future year's return while are rules are already changed.

So, instead of math/programming, tax codes approximate the real world better. Whereas math/programming/images/languages are frozen in time. I find this fascinating. Almost like the legal system, wherein rules are laid out in english but are almost mathematical in the sense that there is a legal/illegal judgement made for almost every action, but that judgement is not easily determined.

bwfan123··on AMD to invest up to $5B in Anthropic
I was waiting for the announced customer of Meta's excess AI capacity. Lo and behold, it is Anthropic.

At this point, openai and anthropic have no problems announcing these deals because is good narrative, and helps them raise funding and IPO.

The same thing happened in dotcom. Deals and partnerships were announced because it helped raise money. I recall energy companies (enron/dynegy) doing deals with network vendors. Eventually, the deals were not worth the ink on paper but it helped raise funding.

bwfan123··on What does the Riemann zeta function have to do with the distribution of primes?
Love the writing style, and I wish all math was written this way. These articles are accessible to anyone who has had some high school math background, and paints a historical backdrop on how the sausage was made (with links to the original papers). Some of these ideas took millenia to develop, and when presented in neat capsule, students are cheated of the mystery and struggle that went into the progression and development of the ideas. I would argue that all math education has to be re-invented to follow this style, ie, uncover the historical progression, wonder and mystery.
bwfan123··on Kimi K3, Qwen 3.8, and Anthropic's (Potential) Unravelling
> There are open source alternatives that have >90% of the functionality, they'll even work w/ Excel files and generate them

Excel has network effects. If N people are using excel, the incremental N+1'th user is forced to use it or risk not being able to open documents from the N users. Excel is also sticky, in the sense that a user used to Excel UI is hesitant to switch to a new UI. Tokens dont have network effects. If N people use fable, the N+1'th user could use any other model, and have no impact.

bwfan123··on Anthropic runs large-scale code migrations with Claude Code
> So, the whole brouhaha was so that Anthropic can write this blog post?

Remember mythos ? I was half-expecting them to scare us with a new danger: How AI can covert code into other languages, and confuse the hell out of all of us.

bwfan123··on Claude Code uses Bun written in Rust now
So, you have a vibe-coded TUI which happens to work, and then, as a workaround you vibe-translate its engine to make it more performant. Where does that leave you ? Basically, fully dependent on AI to fix whatever breaks. Workaround on a workaround is the way I see it, and it aligns with the AI design mentality in general. For a variety of usecases, this might still be a win in terms of overall cost. But, for software that is intended to be built to last, I dont see this approach working out.
bwfan123··on Qwen 3.8
> it usually is good enough for most tasks

The model is fantastic. And costs almost nothing. The only problem I see is that they will train on your data.

There are zero-data-retention providers of DeepSeek models, of which I have used openrouter (with zdr guardrails), and fireworks. But these are 3x to 5x more expensive than directly using DeepSeek, possibly due to poor caching. Thats the price to pay for zdr.

← PreviousPage 3 of 18Next →