HNHacker News
TopNewBestAskShowJobs

mediaman

6,588 karma · joined April 20, 2009

submissionscomments
mediaman··on I have a theory that software drives people insane
Agreed. I find it really fun to work with customers. It keeps you focused on real problems. And there are so many problems in 'boring' industries that need solving. Just a ridiculous number. There's so much bad software out there, or things being done manually, still now so many decades into the industry.

But you have to be willing to break out of the bubble, including getting on a plane, and I see very few people being willing to do that.

mediaman··on Cognition launches new SWE-2 model, Rivaling Fable 5.1 and GPT-Astra
This is a groundless criticism. TB2.1 is saturated. TB4 is not. Sol xhigh is 90% on TB2.1 but 37% on TB4. Is it also "benchmaxxed"?

Your assumption is that the benchmarks are essentially identical in difficulty, with the only difference being their age and thus whether they could have been trained on.

mediaman··on Gemini-3.5-Transcribe
No, that's not correct for any reasonable definition of "impossible." Look up pangram's accuracy ratings. It's not perfect, but it's pretty good. LLMs in fact leave very distinguishing traces of their logit distributions in the text they write. It's one of the reasons why it's so easy for humans to also smell them.

It is possible to trick pangram - they bias toward a low false positive and a higher false negative - but it is not true that it is essentially random.

mediaman··on Qwen3.8-Flash-Next
Just look at the prices that inference providers charge for small models. The argument that these unit economics are negative is trivial to disprove.

DeepInfra sells DS v4-flash at 0.08 in, $0.18 out. Gemma4 they sell for $0.07 in, $0.34 out. OpenAI's price for luna is $0.20 in, $1.20 out.

Why would you assume OpenAI is somehow uniquely incompetent at making small, fast models? And that they're worse at serving it than DeepInfra? Any observer can see they are making money here.

I never understand why people who are convinced there is a big con just don't check market prices and see if there's money to be made.

That doesn't mean their business is great -- they're losing tons of money, but it's because they spend too much on fixed costs, and they can't stop spending money on training next generation models with no end in sight, not because the inference is margin negative, which is a flimsy idea that just clouds the actual business issue.

mediaman··on Qwen3.8-Flash-Next
You can make the other argument that China subsidizes the price and that they can't be profitable at this pricing level. From an industrial strategy standpoint, they already do this for many other industries with huge subsidized state loans.

So we can go round and round on this, each with our made-up objections about how it's temporary or unrealistic or impossible or whatever, or we can just accept the prices as listed and use that to guide our economic decisions.

mediaman··on A week of using Codex more than Claude
Overall I prefer Codex over Claude in their current state, but I do agree that Codex's solutions tend to be too complex and I have to constantly tell it to simplify solutions, detect when it's creating ornate architecture, and proposing data models that have way too much going on. In my usage that's its main weakness.
mediaman··on A week of using Codex more than Claude
As a coda to this, anyone using grok 4.6 via API pricing should be aware that while their headline pricing is good, the pricing that actually matters is pretty bad.

Their cache read costs are $0.50 per million, or 25% of the cost of uncached reads.

The industry standard is a 90% discount, so cache costs you 10% of uncached. So that means 5.6 Sol actually costs less per million cache reads - $0.40/million.

If you are doing a lot of agentic work where the vast bulk of your token consumption will be cached input reads, you won't get the expected cost savings from Grok.

I imagine this is the result of some problem in their serving infrastructure that I hope they will fix, because then the pricing will become actually strong. (The other possibility is that they bet on distracting people with good headline prices assuming they'd miss the bad cache pricing, but I'll give them the benefit of the doubt on that.)

mediaman··on Felony Bench
Criminal acts do not require the victim to "press charges." A government prosecuting attorney decides whether to criminally prosecute the alleged perpetrator.

"Pressing charges" is mostly a made up idea for criminal cases. However, prosecuting attorneys may not want to pick up a case if the victim is not cooperating, because it makes the case much harder to win.

mediaman··on Field measurements of neighborhood-scale air temperature impacts of data centers
Consider that the stance now is banning data centers. That's the context of the discussion.

The county's other option is to simply price data centers. Yes, that means they might not win the data center. If the data center can get better terms elsewhere, they do that. If the town doesn't want to concede on price, then fine.

People seem to be mad that data centers show up with less perceived value to the community than they want, so why would they care if the data center builds elsewhere because they don't agree to their price? The position strictly Pareto dominates the ban stance: at worst, they get no data center (same as ban), at best, they get a bunch of tax money.

Please educate me on how I'm "missing the point" because of how "naive" I am!

mediaman··on Memory prices climb 500% in 12 months
My theory is demand substitution. NVME/SSD is up so much people at the margin are switching to spinning rust, which nobody was prepared for, so now they too are drowning in demand.
mediaman··on Field measurements of neighborhood-scale air temperature impacts of data centers
Simple mechanistic explanations in biology are often wrong. For example, oxidative stress does not have a linear no-threshold harm.

For alcohol, almost every big study has shown either no discernible effects going from zero to 1 drink per day, or actual slight benefits going from 0 to 1 that then reverse when increasing beyond that. There is not strong consensus which of these is true, but there's definitely no real evidence that 1 drink per day is harmful as measured by all-cause mortality.

See GBD 2020 in the Lancet (which showed a slight J-curve), Wood in the Lancet 2018 (optimally low risk at 100g ethanol per week, or ~1 drink per day), Zhao in Jama (no discernible negative effects at 1 drink per day, no benefits either, no J-curve), and the latest National Acadamies review showing lowest all-cause mortality at about 1 drink per day (so, a J-curve).

Alcoholism has tons of negative effects. But these seem to start at around 2 drinks per day and rise rapidly from there.

mediaman··on Field measurements of neighborhood-scale air temperature impacts of data centers
That's not a study from the WHO, it's a public statement they published in Lancet. It's an opinion piece.

Moreover, the WHO never changed their stance when later big studies showed that the "lowest risk" level is not actually at zero drinks.

The timeline was this:

- In 2018, a study was published in the Lancet that was the Global Burden of Disease analysis. They claimed the modeled minimum risk exposure was zero drinks. But the magnitude effects were extremely small: moving from zero to one drink a day pushed the incidence rate of alcohol-associated health effects from 914 per 100,000 people to 918 per 100,000 people. This was the basis of the "no safe level."

- Four years later, an updated Global Burden of Disease analysis, also published in the Lancet, actually reversed course on this. After controlling for more factors, they found risk was actually slightly J-shaped, and for 40+ year olds the theoretical minimum risk was about 0.5 drinks per day. The WHO ignored this updated study when they wrote their opinion piece in 2023.

- Another big study with ~600k participants published in 2018 in the Lancet shows lowest total risk consumption levels at 1 drink per day, with mortality rising above that level. The WHO also ignored this.

- The JAMA study in 2023, with >4 million participants, showed no benefit to low-volume drinking, and also no increase in harms from low volume (1 drink daily) drinking. Again, the WHO ignored it.

Several other studies have shown either no discernible risk change between zero and 1 drink per day, or lowest possible risk at 1 drink per day.

But the WHO and much of the public health policy community ignores almost all of the actual credible science on this because it does not fit with their ideology. It's a huge problem with public health policy: the actual scientists and statisticians are doing great work, but if it's not what the policy people want to hear, they discard it and keep repeating their mantra.

mediaman··on Field measurements of neighborhood-scale air temperature impacts of data centers
What I don't understand is why communities want to block the data centers.

Just make them pay!

Your electricity price shouldn't go up because of them. So just make a rate card for data centers that ensures the burden doesn't fall on residents. That's what Oregon started doing, and residents' electricity prices actually started falling, because the fixed costs of energy production were being spread across more kilowatt-hours and the data centers weren't getting a special deal.

I've also seen counties offer tax incentives. Why? Just have them pay property tax. Then you get nicer schools, more police, better roads.

Instead we have these campaigns to stop them, instead of making them a local cash cow. Loudon County gets half of all its revenue from data center property tax. Its residents were already rich, and now their local taxes are artificially low. Who wouldn't want that?

mediaman··on Field measurements of neighborhood-scale air temperature impacts of data centers
To continue to take us off topic, there is actually pretty limited evidence that this is true.

It is true that wine doesn't do anyone any good (unless you count it making people more social or something). But the effects of one glass a night is indistinguishable from zero. There are definitely statistically significant morbidity effects at 3.

I've been shocked reading public health proclamations that "anything above zero" is bad, and then reading the actual underlying paper they refer to, which clearly states exactly the opposite finding. I think it is an extension of the public policy belief that the public cannot be trusted with moderation, and so therefore must be communicated to in absolutes, and nobody will read the underlying paper anyway.

mediaman··on A Preview of DuckDB v2.0
Clickhouse has a more intentionally built ingestion system. Duckdb has concurrency limits so you can't have a writer and a reader on the same file if they're not the same process (multiple readers is fine).

But that's not too hard to work around. You can either have a single process that owns both writing and reading that file, or you can do a data lake where you post updates as parquet files into object storage, and duckdb handles the catalog. The Quack protocol also basically fixes this (though still in beta).

With Clickhouse, you can of course still have tenant separation, but you have to do it by managing users within Clickhouse that map to users/tenants of your main app, so that you can restrict SQL access by tenant to only their data store. Not a huge deal but I just like the Unix "it's just a file" simplicity of "Tenant A gets to run arbitrary SQL against their separate read-only, no-ATTACH duckdb file".

mediaman··on AI;DR (AI; Didn't Read)
It's possible, but I've experimented with different style guides and prompt methods and have never gotten it to output what I'd call "good" writing.

It is almost always low information density. Sometimes I can get it to remove most of the extraordinarily cliche phrases it injects into everything, along with the tortured, gauche prose (especially Claude). But what remains is an expansion algorithm: it takes a simple idea and expands it like polyurethane foam to fill however much space it can take, the volume filled mainly by grammatical syntax and only traced with any actual semantic meaning.

mediaman··on A Preview of DuckDB v2.0
I do something similar and just use echarts. Very happy with it.
mediaman··on A Preview of DuckDB v2.0
I built a platform for some midsize companies in a specific vertical that is basically a data warehouse with some LLM-driven dashboarding and query tools on top. Typical data size 5-150gb. So I built a service layer around duckdb, where each tenant gets their own duckdb. I'm also in the boat of knowing that duckdb is not the perfect solution for this (the classic use case is running it against local data on a laptop), but there's so much I like about it, and it's really nice that each tenant can have total separation with custom schemas and that it's straightforward to pile data into object storage and form your own lake.

And now with things like quack the sharp points around concurrency are relaxing, and it feels like the compromises of using it this way are disappearing.

mediaman··on Mistral Patent for “Code implemented tool calls”
That poster mixed it up with trademarks, for which enforcement is required to maintain its validity.
mediaman··on Advancing the price-performance frontier with GPT‑5.6
I don't see how this follows. The cost of nails has fallen by 95% over the last century. It's because the cost of manufacturing has fallen. Not because they are selling the information of nail consumers.

Tokens are not normal software, because they have marginal cost, and I think people who are used to software economics really struggle with this. With token generation there really can be manufacturing cost efficiencies where one producer is just straight up better at serving product at a lower marginal cost.

mediaman··on Advancing the price-performance frontier with GPT‑5.6
Yes but there is a big, big market for subagents to consume lots of tokens cheaply and condense information up to parent agents. Luna would not be my choice for planning. But an explorer to comb through a codebase to find relevant parts? Or for enterprise retrieval, where it needs to search across many different types of data to see where to focus efforts for a smarter model? Or to wake up periodically to evaluate some conditions and determine if a bigger model should be spun up? Definitely.

I've previously found flash (for all the hate it gets) to be good for these kinds of things. Haiku was fine but it's ancient.

mediaman··on Launch HN: Tokenless (YC S26) – Automatic model switching to save money
So this only switches models if the cache is cold, because otherwise the economics of switching don't work. But most agentic work involves long strings of successive tool calls that benefit from a hot cache. Hot cache calls reduce input cost by 90%. This can basically only deliver cost savings in turns where the AI delivers a result to the user, the user waits at least 5 minutes (or the length of the cache), and then responds.

But user->AI calls are very much the rare case now, the more agentic the workload. Most of them will be tool->result->tool without the user involved. And token burn is highest with these long running agentic chains, but that's precisely where routing doesn't work because of the KV cache.

How do you deal with that?

mediaman··on Judge approves $1.5B Anthropic settlement for pirated books used to train Claude
None of this matters, this is the judge approving a voluntary settlement reached between the parties last year.

If you think it should be different then you have to make a cogent argument why the public should get to interfere with a settlement the two sides mutually agree on.

mediaman··on My USB Drive Has a Hidden Encrypted Vault
He's saying they just plug your USB stick into some gizmo sold to the state, and it's going to find enough to escalate it.

If the idea is that there's no point in encrypting anything on a USB stick, and you just hope they don't look at it at all, sure.

But there is no threat model here that includes "check the USB stick" and does not automatically lead to finding and breaking "hidden" content.

mediaman··on Gemini 3.6 Flash, 3.5 Flash-Lite, and 3.5 Flash Cyber
Because they don't have a lot of parameters to store general Wikipedia knowledge. They're small. Use big models that have high parameter capacity to store general information. Or build a harness around the small model that searches a knowledge base/internet.

Use the right tool for the job. It's like asking why a screwdriver isn't good at sawing wood, or calling C a terrible language because it's hard to make CRUD apps with it.

mediaman··on Gemini 3.6 Flash, 3.5 Flash-Lite, and 3.5 Flash Cyber
Small open source models shouldn't be used for world knowledge, that's not their purpose.
mediaman··on Gemini 3.6 Flash, 3.5 Flash-Lite, and 3.5 Flash Cyber
Gemma 4 was released in April. It's a good series of multimodal models.
mediaman··on Gemini 3.6 Flash, 3.5 Flash-Lite, and 3.5 Flash Cyber
There was some recent reporting that a July release of the Pro model got pushed back for exactly that reason. Its performance was not good compared to the OpenAI/Anthropic big models. They are having a lot of problems with posttrain.
mediaman··on Who's afraid of Chinese models?
You're correct, but that's a different market segment and not the market GLM 5.2 and its peers compete in.

The labs are not interested in the small, fast, single purpose end of the market. Google increased their pricing on Flash so much that it stopped becoming a cheap model; instead, they released Gemma 4 open source, which is actually easier to use from a third-party inference provider than from Google.

From a total token volume perspective, these "utility" models (classifiers, simple summarizers, small OCR models) will absolutely drive enormous volumes of tokens, at low prices and margin and modest overall market size. Because the models are small and the performance requirements are modest, and because their use cases are specialized rather than general, there are poor economies of scale: they can run cost effectively on rented small GPUs, and a big player doesn't get a structural cost advantage. These models are usually 1b - 30b in size, and can run on a rented 5090. I've productized these myself: I run millions of pages through a fine tuned 1b OCR language model that runs on 5090s at a cost far lower than commercial providers.

But that's not the segment of the market where GLM 5.2, Kimi 3, etc., play. They compete with frontier capabilities, and they are not particularly cheaper than OpenAI models at a cost per task. (I do actually think they compete well with Anthropic, because Anthropic's model efficiencies are poor compared to OpenAI.) And although this part of the market may not be the bulk of the token volume, it is the bulk of the market value.

That's because a lot of human knowledge work is too generalized and fuzzy for dedicated, fine-tuned models, so they are almost entirely different markets that don't particularly compete with each other. (Though if SaaS companies successfully build around verticals that can use small models applied against well-defined jobs, there may be opportunity to push the small/big capability boundary to subsume marginally more valuable tasks that today would require mid-grade reasoning.)

mediaman··on Who's afraid of Chinese models?
The (quite excellent) article discusses several of your points. If you haven't read it, I recommend it.

  - Commodity market profitability is determined by marginal cost of production. LLMs have marginal cost; traditional software does not.

  - Models are not free. Downloading them is free. Running them is not. This has manufacturing economics, not software economics; the idea that they are "free" is an economic category error as it relates to their actual use

  - The highest tier Chinese models are not more economical than US frontier models. Try GLM 5.2 and see how much it costs to do real work. I did, and it was more expensive than GPT 5.6.

  - This is because US labs are leading on cost efficacy of inference ($/task)

  - Training will decline as a percentage of costs as inference expands compute share due to agentic workloads. A big part of training now is optimizing token efficiency. It's hard to distill token efficiency; that is perhaps why Chinese LLMs are so inefficient.

  - With increasing inference as % of total compute, if labs create efficient models -- which they can, because they can create highly optimized models amortized over very high inference loads -- they can be low cost producers, and be competitive at $/task rates
OpenAI really shows the way here. Their cost per task is less than half that of Anthropic because of more efficient tokenization and less verbosity. OpenAI is both cheaper and better than Chinese models for frontier work.
← PreviousPage 2 of 34Next →