HNHacker News
TopNewBestAskShowJobs

arjie

10,975 karma · joined January 30, 2013

Roshan George

roshan@arjie.com

[ my public key: https://keybase.io/roshangeorge; my proof: https://keybase.io/roshangeorge/sigs/6EQyu7jh7oa-KjkTAQBoJJ61fE2RBiZ546abgZc6zsM ]

Blog: https://wiki.roshangeorge.dev/w/Blog

I use https://overmod.org to manage highlight/block

submissionscomments
arjie··on US Reps Lead Democratic Resolution Opposing A.I. Bubble Bailout for Big Tech
That’s the dream (which is what I meant by “everyone would love to do that”), but what you gain in the cost of money you lose as demand eats into supply ahead of you.

Right now, the lead time of these racks is like 36 weeks and they’ll want payment down unless they’re sure you’re good for it which is in the $100m range. You just try to get them as soon as you can because and when the integrator and Nvidia can get them to you.

I don’t understand what the problem is here. You think they’re damaging their own economics on purpose? Every time I’ve been involved in hardware procurement, it’s been the case that you try to get things as fast as possible on everything because you never know which seemingly fixed lead time suddenly clears.

If you intentionally bake in delays you’re guaranteed to not make it work, esp. in a demand crunch. My GPUs are SMB/prosumer range and even they are much harder to get now. The smartest thing I did was lock in my purchases in January. If I had been unable to negotiate the rack space it would have been suboptimal but if I had decided to wait for guaranteed time I would have been screwed. As it so happens I should have gone to 2TB VRAM instead of aiming low.

This is the calculus that all businesses are facing, not just mine.

arjie··on US Reps Lead Democratic Resolution Opposing A.I. Bubble Bailout for Big Tech
There are definitely datacenters that aren’t live due to power hookups. Is the idea that we should precisely time both? I think everyone would love to do that. To the extent that GPUs are not in production, it’s not because they could be and are not so. Literally everyone who buys them is trying to put them into production because they’re as close to a money printer as one can legally have. The operating margins on a running GPU are incredible.

Even my old RTX 6000 Pros would be profitable if I rented them out.

arjie··on Sam Altman Thinks You're Wasting DRAM
It would be interesting if there were some kind of holographic LLM. You could send part of the encoded prompt and receive generated tokens that only you can decode. Then we could use the distributed capacity of the world and everyone could be paid for marginal token generation capacity. Even open models are profitable to run on almost all electricity.
arjie··on US Reps Lead Democratic Resolution Opposing A.I. Bubble Bailout for Big Tech
Is the idea that buying GPUs before you buy the datacenters is hoarding but buying datacenters before you buy the GPUs is not? Everyone would prefer to put all their capacity into play. Demand is so high that every marginal computer here is marginal operating revenue.
arjie··on Medicare Will Pay $50k for Your Heart Attack. It Should Pay $100 to Prevent It
In the limit, one would expect that to be the case: at some point the marginal cost curves will intersect. I’m quite surprised that we are already at that point. I suppose more things are at the efficiency frontier than I had imagined.

Thanks for the link. Will have to read it later.

arjie··on Study: Schoolwide phone bans show no significant impact on mental health
Very interesting. Can anyone explain why phone ban / no phone ban has pretty much the same screen time? Also, is Iceland one of those countries where children have personal computers in class?

It's certainly counter-intuitive.

arjie··on Claude Duet is the first personal-assistant-type harness that feels useful
I do agree. We have a household assistant and it's not particularly different in functionality from the ones by mainstream labs. It's not a lot of work to build. Because we run on our own LLM base we can also do things like plumb our home cameras into it and so on.
arjie··on Grace Blackwell needs a new scheduler: 27% more usable GPUs from the same racks
I treat it as more akin to the (slightly more-awkward) "single-digit millions" whereas "millions" could go over. It's just a SV-ism. I usually find it pretty easy to disambiguate and I confuse it as little as I do the same / in dy/dx vs. 1/2. Notational overload is pretty normal in human communication, I think.
arjie··on The importance of communities around software
We’re in the tabs v spaces of this era. It will be forgotten. No one debates BSD v Linux. No one remembers SCO. Or whether silverlight will be ported. Or whether an app is available on Linux/Mac. Or whether drivers exist for their hardware. Or whether web standards are adhered to. Or whether you have to use a proprietary compiler.

Everyone thinks AI vs non-AI is a debate but just like all of those, it’ll be meaningless to the engineers of tomorrow.

arjie··on Patrick Stewart has died
He was technically my landlord in London, haha. Never met him, though. Only found out because the council sent me mail addressed to him regarding the property. From the visible window on the letter, I was able to find that it was to pay for extra sound insulation on the apartment I was residing in because the council was building some structure nearby.

Really enjoyed his stuff. Always enjoyed that he could do both the grand and the silly with equal aplomb.

arjie··on Grace Blackwell needs a new scheduler: 27% more usable GPUs from the same racks
It's not Big-O complexity notation. It means "a few millions". It's sort of how the word "sanction" can mean one thing or a different thing. The textual glyph sequence means a different thing based on context in English. Pretty normal.

I like to call it Big-O Magnitude Notation.

arjie··on We're releasing the weights of Mistral Large 4
You're just going to have to try it. It won't take that long to quantize. Unless the server is currently serving traffic you should be able to get it going in under a day with a frontier model doing the driving for everything - quant, implementation, etc.
arjie··on LLM Voice
The other day I was writing a blog post summarizing how I use an adaptation of a context handling technique and I wrote the following three lines:

* Every user run becomes a memo

* Days summarize, rolled to weeks, rolled to months - all written once

* Today's runs are shortened and placed into running context past the cache break

Then while reading it before publishing it, I thought it sounded super LLM-y. I didn't rewrite it because I jammed that stuff together before hitting publish because I was in a hurry but now that I go re-read it, it's somehow worse. Dear god. It's happening.

The classic thing is this business with inanimate objects verbing metaphors or becoming other objects. It's a strangely uncanny valley, but I suppose I read so much of this with Claude that it gets stuck in my head!

arjie··on If IPv4 were land
Ah, I misunderstood while skimming the comment thread. Reasonable claim. Thanks for explaining.
arjie··on Gemini 4 Carbon is the new #1 on the Artificial Analysis Intelligence Index v5
Gemini team has a long history of releasing great benchmark charts and disappearing into the ether. There has never been a moment where I have preferred them to Claude/Codex. When I get access I eval them on my home assistant set, a small coder benchmark, etc. and they are too expensive, and too low quality.

The benefit for Google is their chat interface has privileged access to their data (maps, etc.) but their model itself is low quality and, if I'm being honest, has the promotion-oriented measurable-output bias that FAANGs tend to have. The later Llamas had the same problem.

arjie··on How Google determines the names for bodies of water in Google Earth (2008)
For corporations in a country to be subject to and follow the rules promulgated by the elected authorities of that country is normal and just. To 'capitulate' or 'not resist' the President of the United States is fine. I cannot be bothered by this. In this case, it seems a natural extension of the non-English policy to a world where the Anglophone nations are in conflict on naming:

> For language clients other than English, we display only the preferred name in the relevant language. For example, the Japanese client of Google Earth shows "Sea of Japan" in Japanese (日本海), while the Korean version shows "East Sea" in Korean (동해).

arjie··on A Health Update
Thank you for the authentic process and experience documentation. I enjoy the incorporation of these memories into my own self-world. Very valuable.
arjie··on If IPv4 were land
128 innit? Otherwise your /64 would have no subnets.
arjie··on New York Times adds more AI features to its Cooking app. Users aren't thrilled
There's no way anyone knows where the limit is of a feature set that is valid for AI enhancement. Substitutions and changes in amounts across a dataset that is not fully pre-taxonomized seems like a pretty good use of AI to be honest.

We've used it for modifications to enjoyable effect a few years ago https://news.ycombinator.com/item?id=46131280

So it's a matter of execution etc. to see which features stick.

arjie··on The tragedy of losing your Wikipedia page
I've agreed with occasional deletions. Without that mechanism you just get self-promotional content. That stuff still makes it, but I think it makes Wikipedia poorer to be a Forbes 500,000 Under 500,000 explicitly. It's probably worth it to run a separate deletopedia that preserves the content but I don't think Wikipedia should be exhaustive. It's pretty good at only containing sufficiently notable things. One could argue that more things should move to fandom-style wikis and I think perhaps the Pokemon are better on bulbapedia etc.

We don't have a neat interwiki search yet that makes federation work well, but in time perhaps something like that will develop.

arjie··on CNC Stone Carving
Monumental and Robotor do this

E.g. https://x.com/Monumental_Labs/status/2102775795689419214?a=x...

https://www.cbsnews.com/news/robot-role-marble-art-sculpting...

arjie··on Evidence of a spying operation by ICE against left-wing social movements
Yeah, I think narrow wins are the only ones you can count on. Those require participation. Otherwise it’s all local constituency branding.
arjie··on Regent's Ground-Effect Vehicle Reimagines Coastal Travel
It would be cool to have a fast electric ferry service around the Bay Area. Ride your e-bike to the ferry terminal and get to the other side! Cool traffic dodge.
arjie··on MacBook Pro with PROLED XDR Display and Touch
I see. The iPad and Macbook are converging. Interesting. I can’t say I get the use case but perhaps it will fold in some interesting way that makes it usable. I have no problem using a touchscreen occasionally but in the standard configuration the screen will wobble if you touch it.
arjie··on Gemini 4 Carbon
I always forget they have a model by the time I actually get access.
arjie··on In Leaked Audio, Flock CEO Tells Cops Backlash to the Company Isn't Real
I have a set of links here with summaries so you can take a look and see[0]. One example is in describing Democratic Party mayor Eric Adams’ statement who has used it elsewhere.

To be clear, I said and meant blue-tribe so that we can avoid discussions about whether the Dems are left or not.

0: https://news.ycombinator.com/item?id=50251488

arjie··on Evidence of a spying operation by ICE against left-wing social movements
Votes that lose by a large margin have no information. They’re commitment free actions taken purely for political gain. Narrow wins are the only ones where you can really learn something.

If everyone else is voting for some necessary evil, it frees me up to vote against it while still wanting it.

arjie··on Wealth Inequality in America drawn to scale
First the premise of our socioeconomic system. I disagree entirely. Our system is premised on the thesis that if you are useful to others, they are willing to reward you for the utility you bring them; and that it is advantageous for us collectively to preserve a rule of law whereby people might interact safely in this way.

One might work hard and fail or one might work lightly and succeed. Bulletball guy certainly worked a lot harder than many product managers I know.

Now the question of assets of limited supply. That’s sound. But that’s a distribution of assets of limited supply problem. It is entirely possible to have great wealth inequality with low land ownership concentration - in the US 67% of people live in owner-occupied housing. Scotland has much higher land ownership concentration - but lower wealth inequality.

So fixed supply asset concentration can exist without wealth inequality - which, to be clear, is the form of inequality I was talking about considering the original post is about it.

arjie··on Wealth Inequality in America drawn to scale
EMA food prices in number of hours of work required to sustain oneself and they have fallen for half a century. Bill Gates has not only been alive for the entirety of that period but he has been leading Microsoft for the majority of it. If this is how the list is (and I’m simply going to judge it by its first element) then it seems to provide stronger evidence against equality being a prime goal, considering wealth equality has dropped during that period.
arjie··on Wealth Inequality in America drawn to scale
Rank order of income inequality (and coincidentally wealth inequality): South Africa > US > Vietnam

Rank order of preference to be top 10% in for me: US > Vietnam > South Africa

So your method does not disabuse me of my belief. It’s quite clear that equality has not made Vietnam more desirable than the US. In fact, there are some 400k foreign born in Vietnam (<1%) vs the US having 15% foreign born (a stark enough difference made worse by forcing foreign-born to be from non-neighbors). So I must reasonably conclude that my rank order is likely shared by others and that others too are not, in fact, lured by equality.

There is an old immortal tweet: cars have windows and go; houses have windows and don’t go; so it’s not the windows that make things go.

If inequality were as critical we’d expect a perfect rank ordering of distant migrant population attempts matching it. The numbers are so vastly different that one cannot conclude equality is of great importance to most.

← PreviousPage 4 of 34Next →