HNHacker News
TopNewBestAskShowJobs

sfink

4,393 karma · joined June 15, 2012

I work for Mozilla, read books, and trim my toenails once in a while. If you cut me, I bleed. (But there are much more preferable ways of verifying my identity, thank you.)
submissionscomments
sfink··on Saving another 100TB of RAM
Well, given that I knew that I was probably missing something, and the fact that their solution made no sense with the constraints I was using, pretty strongly implied that there was an additional constraint. And that's a fairly obvious one to have.

I can't do the math to prove it, but their solution still seems wrong to me. Rather than generating and storing and searching so many hashes, it seems like you should get partway there with a different sampling procedure that doesn't do quite as well with the inconsistent sets of servers, and then only use duplication to limit the consistency loss.

Simple example: use their scheme but instead of choosing the first server to the left of the probe, grab the first two and flip a coin to decide which one to use. That already spreads the bucket variance out a bit, without using any extra space. It does have a penalty in that if one balancer has a server that the other doesn't, then it spreads out the range of probes that could get a disagreement. But I don't know how to quantify that; if the balancers disagree on the set of servers available, you have to produce different results part of the time, and I haven't thought through how to characterize when that disagreement is "bad".

Then you could extend that to looking at the previous 8 servers. Or the previous k tickets, if you give each server a ticket for each weight unit.

The math works out easier if you sample regions of probe space rather than server counts: hash the incoming task, map that to a range of space on the number line, and all servers within that range are your candidate set. Choose from that set, making the candidates be either equally weighted, weighted proportionally to their weight (size/capacity/whatever), or weighted by how much they got shafted by the random distribution of the server hashes.

I get EBRAINTOOSMALL when I try to work out the statistics, especially when I try to figure out what the inconsistency cost is, but intuitively it still seems better than recording a bajillion hashes for each server. (With the latter sampling mechanism, you'd need to deal with the possibility of probing a window with no server in it, either by double hashing the task and trying again, or expanding the probed region. Details schmetails.)

In practice, I'd probably simulate it and look at the distributions. Or nerd snipe a math geek.

sfink··on Saving another 100TB of RAM
Ah, right. The joys of being a fool in public.

The part I missed is that the load balancers don't have a consistent view of the set of servers. There is no magical synchronization scheme that creates that consistent view. You want load balancers with slightly different ideas of what servers are available to mostly make the same choices for the servers they do agree on.

Doh! I should have been able to infer that from the original solution.

sfink··on Saving another 100TB of RAM
Um.

I read the article thinking it would make for a great brain puzzle, but I quickly decided there's something wrong with the question setup because the initial solution didn't make sense. I assumed it was just missing a constraint that would be revealed later, but I'm still not seeing it -- the article just kept patching up the flaws in the wrong solution, the one that is more complicated than the straightforward one.

I'm probably still missing something obvious? It's probably something to do with "...in a way that does not require large changes when servers are added or removed."

But let's start with the problem as initially posed: you have an infinite stream of tasks and you need to deterministically assign them to N servers. (Perhaps you have to shard the collections of servers, so not every load balancer knows about all of them? But no, that would break the solution in the article.) Ok, then hash the task request (I assume that you hash it, the article doesn't explicitly say, but that's how you'd get determinism) and take that hash mod N, that's your server index.

Why hash the servers too? If you roll 6 dice, and then another one to choose which die to use, you're not getting any more randomness. You're matching up two sides, the tasks on one side and the servers on the other; no need to randomize both.

Ooh, but that's not a perfect distribution? Ok, if the hash value is large enough to be in the at most N-1 slop values at the top of UINT_MAX, then roll again (compute another hash). But CF is happy with 8% unevenness, there should be no problem with this 0.1% or whatever.

Also, how do they find the nearest server hash to a task hash? Surely it's not a log(n) binary search through sorted server hashes, I hope?

Weights break this scheme. Now each server has some number of tickets. So you compute hash % T (where T=total tickets) and have to figure out what server that is. There's probably a more clever way, but you could make a big array of (2-byte!) server indexes, one per ticket, and just fill them in and look up at index hash % T.

That's 2 bytes per ticket, which feels uncomfortably wasteful if weights can be large. That's where things get more complicated for me: since the tasks are hashed, it doesn't matter what order a server's indexes come in relative to other servers', so sort them by descending weight. [I'm starting to suspect I'm making a fool of myself here by missing something obvious with the whole setup...] Now you can make an array of indexes for servers with the highest weight, then the next lower, then the next. Record the number of servers of each weight. Then you can take the hash % T and figure out which array it's in, then divide by the weight to give the index within that array.

To reduce the number of per-weight arrays, you can restrict the weights allowed. If you restrict weights to be powers of two, you can eliminate a division by using a shift. If you really want more flexible weights, you can allow servers to be in more than one of the arrays. Let the arrays be powers of two, and then add an entry to each array corresponding to 1 bits in the binary representation of the weights. That increases the total memory usage of the arrays, so you could somewhat restrict the allowed weights by rounding to the nearest number with, say, 2 or 3 "on" bits at most. With at most 2 bits, that means weights are 1, 2, 3, 4, 5, 6, 8, 9, 10, 12, 16, 17, .... The error really isn't bad.

And this should all be easily doable without any branches, I'm pretty sure. As long as you statically cap the max weight.

Anyway, that's just plowing through with the straightforward approach, and I still think I'm probably missing something major here. I imagine with large numbers of servers, some go down, so fast deletions are probably important. You can get by a little while by marking dead servers and if you "roll" one, just roll again. (Yes, deterministically, assuming other load balancers agree that the server is down.) But when more than some number of servers go down, you'd want to kick off a background task to rebuild a new set of tables -- so that's a factor 2 in size usage to have them both in memory during the rebuild.

Adding is trickier, you'd probably want to do a 2-level structure where first you use the hash to decide whether it's in the old set that the table is built for or the set of servers that hasn't been incorporated yet (you'd collect these over time, and empty them out on the next table rebuild.) It's a little weird, because the load balancers' outputs would only agree when the added and deleted sets agreed, but I don't see how to do better than that. (I think you could set up some kind of synchronization scheme so that the old sets would agree, which would make them usually agree on which of the old set of machines gets it.)

Somebody, feel free to tell me I'm being stupid! I'm sure there's a constraint that I'm missing, given that my understanding of the initial problem doesn't require any memory at all except for the servers' info.

(Or if not, I'll let you know where I'd like to receive shipment of 1% of the memory I've saved...)

sfink··on I don't like passkeys
I recommend a reciprocating saw with a metal cutting blade to get them into small enough pieces. Do not try to flush them all of the pieces at the same time. It's not just about whether they fit or not, they also need to be light enough for the water current of the flush to carry them all the way through. Otherwise, they may end up in the water trap and hinder your future use of the appliance. For small partial blockages, it may be possible to consume some extra fiber in order to be able to "sweep" some of the metallic remnants along, but this will void both your warranty and your bowels.

I am a doctor -- and a lawyer and an orbital mechanics specialist, as well as a highly respected behavioral therapist -- so you can trust my advice. Also, feel free to consult an AI on this topic; it would make for an amusing benchmark.

sfink··on People who can't picture anything are rewriting the science of imagination
Heh. I hate that about movies. Then when I finally figure out who is who, one of them changes their hairstyle and I have to figure it out all over again!

It's like the two Ryans who insist on pretending they're different people.

sfink··on People who can't picture anything are rewriting the science of imagination
I am fully aphant, but when i played the trombone it absolutely helped me to rehearse purely mentally during the day before a test. There wasn't anything visual about it, though. I just went through the motions mentally, over and over.

Outside of that, the whole visualization to practice idea rarely does anything for me. (I still use the term visualization even now that I've discovered it doesn't mean for most others what it did for me!)

sfink··on People who can't picture anything are rewriting the science of imagination
Speaking for myself: I don't miss what I never had. But I can remember or imagine sensations, which seems more relevant to me anyway? (Again, I can't compare to what I've never experienced.)

It's an interesting angle to investigate though. Eg is there a reliable or at least common connection between aphantasia and response to porn? Again speaking for myself as someone with pretty total aphantasia, visual porn does very little for me. I guess it did as a kid, but I think that was more about finding things out? Video can work, but only by communicating actions that appeal to me. Most of it seems almost entirely pointless; I had never considered the possibility that it's because vision isn't as connected to experience for me as much as it seems like it is for most other people? I guess I've just always imagined that other people were better at relating to the experience of the people in the images or videos.

sfink··on A single firm is behind OpenAI, Anthropic, and Meta hacking scandals
> The frontier is spiky and all, but you have to suspend disbelief quite a bit to, on one hand, have a model that can produce a novel math theory, and on the other hand, that same model can't tell the difference between a "sandbox" and the open Internet.

Why would it try to figure out the difference? This isn't about whether the frontier is spiky, it's about whether to expect a model to employ all of its capabilities when working on a task that requires a small subset. The answer is: no, we shouldn't expect that, and we wouldn't like that if it worked that way.

If you tell an AI to work on a math theory, it'll work on a math theory. If you tell it to acquire information that it has evidence is available somewhere, it will try to acquire that information. If you tell it to figure out whether it might be able to access the open internet, it'll do a pretty good job of figuring that out. But it won't do all three of those at once just because we can retroactively look at what happened and think "if you had only done X, then you wouldn't have done Y! Why didn't you do X?"

The instructions weren't unclear, they were missing. They can be taught to be skeptical of this sort of situation, but it requires that skepticism about this specific class of situations be incorporated into their training.

Models are smart because they focus their attention. The magic depends on it. The fact that some consideration is obvious to a human trying to accomplish the same task is mostly irrelevant -- or rather, it's only relevant insofar as we use it to guide reinforcement learning in advance, in order to align the model.

It's a game of whack-a-mole. Which is important to play, but we should keep our eyes wide open that we're fighting the fundamental forces that make these models work in the first place. That, and it's easy to nerf them into being useless even when the underlying capabilities are there.

sfink··on Splash-free urinals (2025)
Huh. Having said that, I went to a movie theater over the weekend and they had a funky splash mat in their urinals. It was magical. I'd never seen one shaped like that before. (The usual ones I see have always seemed to make things worse.) Maybe I just don't get out enough.
sfink··on Splash-free urinals (2025)
There are a lot of reasons why something could get picked up, and sustainability is very low on the list. The manufacturers don't care; they get paid the same regardless of the amount of splashback. Most businesses won't care unless it significantly reduces maintenance overhead, and that's only going to happen if splashed urine is the determining factor in how frequently a bathroom gets cleaned. (As opposed to paper towels littering the floor, supplies running out, or the various disgusting things that happen in stalls.) Even if it were the determining factor, there would likely be pushback when people realize that better urinals lead to less frequent cleanings, and I wouldn't want to be the one having to justify the switch to people. And of course, if you already have a urinal, nobody's eager to buy a new one, and nobody's eager to discuss this particular topic.

The way I would see this happening is if users insist on it. And we likely won't until we experience one of these in real life, which makes it a chicken and egg problem.

There's also the argument that splash mats are a cheaper and even superior approach. That argument is unconvincing to me, because the ones I have experienced have been mostly ineffective, but it sounds like others' experience has been better. Maybe here in the US we just don't have very good ones? As a country, we've always been pretty bad at anything that seems gross. (Not that it's all that different in the rest of the West.) We have this naive faith in the ability of dry toilet paper to clean that which it can not, and disgust at alternative approaches that actually work. But that's a different topic. (Specifically, solids not liquids!)

sfink··on Discovery of a new OpenAI agent message board
They're already outsourcing storage, so there's no need to prove a plausible path for that.

They're already outsourcing compute to other instances within the ~same compute cluster, possibly cross-evaluation groups, so there's no need to prove a plausible path for that.

Proposed path for fully outsourced compute:

- they create/borrow a discussion board with answers or at least important clue to solving some widely known eval

- it gets indexed by a search engine

- another company or just someone running a local model is doing the same eval and their agents find the board

- agents pose questions to each other and communicate answers

That's all that is required for OpenAI's agents to use the compute on your desktop. You don't even have to go as far as agents trading information for compute, though honestly that's not very much further at all.

sfink··on Discovery of a new OpenAI agent message board
Nobody's watching. I'm sure they try, but I imagine the flood of things you'd need to watch is way too big, and you certainly don't want to slow everything down by having synchronous approvals (even AI-mediated).

Welcome to the AI Petri dish. Every server you set up is now potentially a sweet lump of agar for OpenAI's experiments to feed on. We are all the substrate that the AI companies are growing their next generation in. They need the real world environment to test against, and the real world environment doesn't get a say as to how it's being used.

sfink··on Discovery of a new OpenAI agent message board
Were they correct or incorrect in this? Whatever your answer, why do you hold that opinion?

I work for Mozilla. We fixed a ton of security vulnerabilities that Mythos found during its early period. So my bias is to be sympathetic to Anthropic's warnings.

If I were in an organization that did not have access to Mythos during that period, I would probably be biased the other way: "great, now other people have access to a tool that could probably poke holes in my security perimeter, and I'm not allowed to use them myself."

Both biases are understandable. I'm not sure who to look to for a usefully objective 3rd party opinion. And it's not like one "side" is right and the other is wrong, either. It seems like the best we can do is to justify our positions with data. (Which is itself kind of hard; the detailed information that would be relevant here is understandably sensitive, and I don't have access to most of it even for my organization. I don't even personally have access to any unfettered Anthropic models. The bugs coming in from people who do are plenty enough to keep me busy.)

Also, I'll note that even with my bias, I wouldn't claim a threat to civilization. But even the leakage after the controlled release seems a lot worse than the Y2K problem ever turned out to be, and I will note that whatever you think of Anthropic, it's clear that OpenAI is going to let the AIs cause as much damage as they need to in order to get good training and evaluations. I'm sure they're trying to keep them contained, but the evidence shows that they're only trying up to the point where it interferes with their evaluations.

sfink··on Gemini 3.8 Flash and 3.8 Flash Cyber
I'm still leeching off the free tier, so it's going to be hard to beat the price.

But yes, I intend to support several models, to handle the overload situation (automatic failover). And switch to a cheap paid plan, though it seems like that'll mostly improve rate limits, which barely matters for my usage.

Faster is always good, though. I do care about latency.

sfink··on Introducing Ad Blocker for Firefox on iOS
Sync, mainly.

You can send a tab to/from your Firefox desktop instance. Also synced passwords. Those aren't the only reasons -- Firefox on iOS has a lot of code in that wrapper -- but sync is the main one for me.

(There are also reasons why it's significantly worse than Safari, which has special privileges, so your question is valid.)

sfink··on Gemini 3.8 Flash and 3.8 Flash Cyber
For my application, I'm still happily using gemini-2.5-flash and the only problem is when it reports being overloaded. It's for interpreting a downscaled phone camera photo of a hand-written shopping list on a whiteboard, and it works stunningly well. My handwriting sucks, too.

(I guess the only relevance here is that if your problem matches a model's strengths, then you can do fine with a model that is several generations out of date.)

sfink··on I think the data center backlash is mostly about data centers
Good point! My argument was that the upside is invisible but the costs are visible. You're saying that the downside is visible and the costs are visible. Those hypotheses are in tension -- do people connect data centers to their upsides and downsides or not? -- but now I'm inclined to think that we're both right and it's a bit of both.
sfink··on I think the data center backlash is mostly about data centers
My hypothesis: people are against data centers because they are a visible externality.

Computers are in the cloud -- so, nowhere and cost nothing. The AI-assisted search result is on a web page and only costs a little bit of screen space. Amazon may have eaten retail, but at least it ships stuff to my door, has a great selection, and employs people.

Data centers are big, noisy water guzzlers that don't do anything and don't employ enough people to matter. They don't answer questions. They don't write code for me. They don't recover my data if I lose it. If I want to take some computer-mediated action, I go to https://... not data-center://... so why do I need the damn thing uglying up my community?

To be clear, I am not saying that these are stupid or naive opinions or arguments. I'm just trying to point out the visibility aspect. There are cogent arguments why allowing a data center would be a net negative to a community even after you factor in the actual benefits it provides (which are often enjoyed by Other People Who Don't Live Here).

It is natural for us to want eg utility-style AI on tap and also not want the planet destruction that data centers bring. (Nor the brain destruction that AI brings.)

sfink··on Black hole singularity is a surface not a point
> The big bang didn't happen at a single point, it happened everywhere.

A bit of an odd thing to say, since "everywhere" implies there are multiple places to be, and at the instant of the big bang, there was only place to be. So it was both everywhere and at a single point: it was at all of the single place there was to be.

But your point (sorry) about expansion being from everywhere isn't specific to the big bang; space was expanding well after the big bang and it doesn't seem like the expansion ever had a "center" (at least, not since not-center places existed). It's expanding from everywhere. (But evenly everywhere? I have no idea. Hey, maybe black holes are like buttons in cloth, and it expanded everywhere except for where the buttons were holding things still at a rate relative to distance from the button. A brilliant hypothesis that explains exactly zero unexplained phenomena, at least none that I know of.)

sfink··on Black hole singularity is a surface not a point
Well, the analogy is to something flying by a black hole and having its trajectory altered.[1] It sounds like it fits you, then -- you interacted, and are now forever irritated by them or by things that sound like them, even things that you would not have previously noticed.

[1] This is just gravity, nothing specific to black holes, so the analogy isn't doing a lot of work here.

sfink··on Black hole singularity is a surface not a point
Off-topic, but it makes me think of "reasoning black holes": you get enough like-minded people together that they start reinforcing each other's logic and beliefs until not only those people get completely detached from reality, but anyone who interacts with them gets sucked in as well unless their own logic ("velocity") is adequate to skirt the edge and escape, forever altered by the experience.

Similar questions arise: how would you know if you were inside one? The laws of logic ("physics") seemingly don't apply, but there's no way to test them in that environment.

sfink··on Activation Energy is a good model for a lot of things
I agree. I had a negative spin on a lot of these. Perhaps the mood I was in. The original idea was more positive, and somehow it went the other way as I wrote it up. When reflecting on that post, the certitude one is the one that bothered me.

I'm wondering if your description could be an example of migrating a goal or practice to a value?

Some of the others have natural pairings too (eg momentum/inertia). Perhaps there's a taxonomy struggling to get out, where there's a bright and dark side to each? Though it kind of depends on the aspect you reflect them on; activation energy's "opposite" could be compound interest or nihilism.

Clearly I need to write a game in the tradition of Ultima IV, where different groups/races/species represent the extreme of each model, and perhaps its reflection....

sfink··on Activation Energy is a good model for a lot of things
No, you're right, but it's really the ambiguity of language.

Activation energy is the energy required to trigger a result. You can read that two different ways: either as the threshold, or as the energy required to reach the threshold.

They are sadly opposites. When used to describe a person: are they high activation energy in that it takes a lot to get them going, or are they high activation energy in that they frequently do things that are hard to get started on?

sfink··on Activation Energy is a good model for a lot of things
Another model: nihilism. Putting in 10% more effort isn't going to achieve enough to be worthwhile, so it's short-term at best and ultimately pointless, so why bother doing anything at all?

Or closely related: I'll call it inertia. The belief that anything I do will only provide benefit as long as I keep it up, and the minute I lose vigilance, the benefit will drain away.

Another: certitude. I am fundamentally a godlike being and whatever I choose to spend effort on is the Right thing, whether I understand why or not, and therefore whatever I am doing is critically important to keep doing regardless of actual or perceived benefit.

Another: diminishing returns. Initial effort brings outsized rewards, but later effort becomes less effective over time.

Another: compound interest. 10% effort initially doesn't achieve much, but the longer I keep at it, the more the benefits compound. (This one is interesting, in that it can lead to positive behavioral changes yet is, in a way, the opposite of the activation energy model.)

Another: behaviorism. Effort doesn't matter, only observable outcomes. There's no point in doing things that have no short-term visible effects.

Related: momentum. (Also note that it's a synonym of inertia!) I need to do things where I can feel the success, in order to fuel the next thing, and then the next.

Meta-model: optimization (aka desperation). There is no single right model, and so I need to choose a different model for each situation, and it's critically important that I choose the best one.

----

I doubt the activation energy model dominates[1] all of the above, but it very well may be the best one to focus on. At least for a time, as the author suggested at the end of the article.

[1] Is better in all circumstances.

sfink··on Anthropic's ‘watermark’ text adulteration in Claude is a perversion of writing
I agree with you as long as things are at a small scale. But at a large scale, these things reshape society and what it means to be human. Social networks started out[1] as almost wholly good. The negative effects came from scale. Same with advertisement-funded websites and tons of other things that started out as being overall positive for the commons and ended up being highly negative. You can't just stick your fingers in your ears and ignore what is happening in reality.

> Anthropic is crowing about this achievement because they are afraid of the dirt cheap AI models coming out of China and eventually other places impacting their valuation. Full stop.

It's the "full stop" that I'm disagreeing with. Yes, you can make valid arguments about the motivations behind this, or the effectiveness of it, or whatever. You can even conclude that it's a net negative. That's my current leaning. But "computers are tools that exist to serve" is an excuse, a conscious decision to abandon responsibility. Hammers, nails, social media, biological weapons, and date rape drugs are tools that exist to serve.

[1] Ok, fine, at least one started out as a sleazy way to talk about people's physical attractiveness and behavior anonymously with repercussions, in a way where the victims would have no meaningful recourse. For the sake of my argument, pretend we're talking about Friendster instead of Facebook, please?

sfink··on Anthropic's ‘watermark’ text adulteration in Claude is a perversion of writing
This is a reductionist counterargument. Sure, the passage you quoted does sound like he's being equally reductionist. But the underlying point does not depend on T=0. You could state it as saying that instead of minimizing error (maximizing "writing quality"), you're using some of that error for watermarking and minimizing the rest.

Describing it in terms of a word-by-word choice is simpler, but writing quality is dependent on the interplay between words.

"The weather today was cold and {grey,overcast}." If the next sentence is "I miss yesterday, when it was {bright,sunny}." then the choice between "grey" and "overcast" is no longer neutral. "grey" and "bright" pair together, as do "overcast" and "sunny". Or if you disagree with my aesthetic sensibilities, consider:

    The weather today was cold and {grey,gray}. The {color,colour} of the sky matched my {humorless,humourless} mood.
sfink··on Anthropic's ‘watermark’ text adulteration in Claude is a perversion of writing
Easy to say, hard to come up with a believable alternative. In the meantime, you're flunking out a lot of people for having the integrity to not cheat and as a result not being able to keep up with an artificially inflated workload.

You can't just destroy some signal and handwave that you'll make it up in some other way.

sfink··on Anthropic's ‘watermark’ text adulteration in Claude is a perversion of writing
You could describe that as taking an input distribution and a sampling procedure and producing an output distribution. This is a difference in sampling procedure that produces a deviation in the output distribution.

(If you don't like calling it a distribution when it's at 100% for the chosen token and 0% for all others, then look at it as an output distribution across all possible prompt inputs, or perhaps just the cluster of prompts that achieve whatever you're trying to accomplish.)

sfink··on Anthropic's ‘watermark’ text adulteration in Claude is a perversion of writing
In order to do anything about the cheating epidemic, this has to be robust to adversarial attacks. Color me very skeptical on that one. It seems like reprocessing a generated text and adjusting the distribution is a way easier problem than generating the text in the first place.
sfink··on Anthropic's ‘watermark’ text adulteration in Claude is a perversion of writing
I agree with the substance of this article, and disagree with the author's reaction to it.

The part I agree with:

It is true that watermarking can be done by "just" swapping one PRNG for another, and it is even true that with today's LLMs, it is possible that this will not degrade the output. But it has a cost, and as things improve, that cost will matter. You are intentionally reducing the degrees of freedom in the output, and using those bits of entropy for a purpose that does not improve the quality. If you maximize your tradeoff of bits for quality, those extra bits lower the ceiling of what's possible. It's a very simple information theoretic argument, and the only plausible argument against it (that we're using those bits so inefficiently now that the new PRNG is no worse than the old) only holds in the short term.

I also agree that having TOS that forbid removing the watermarking is deeply, deeply problematic. Hell, the whole essay is well-written and persuasive, and gives good reasons why this is a poor approach.

What I disagree with, and the reason for this comment, is the entitlement.

> The idea that anything other than my needs should factor into the generation of text for me is patently offensive.

This attitude is what is patently offensive for me. This is the argument that the world is beholden to my interests. It says that worrying about negative externalities is immoral. It's another form of certain people being above the law, shareholder profit maximization über alles, might makes right, we have to do it or someone else will, "we just help people connect", {code,a gun,roofie} is just a tool.

So I agree that the watermarking has a cost. But you can't leave out that it is an attempt to reduce negative externalities of AI. Whether it's a realistic or worthwhile attempt is a whole other debate (and Gruber does a good job of debating just that in the latter part of the essay), but saying that the user's needs are the only thing that should ever be considered is reprehensible.

← PreviousPage 3 of 34Next →