HNHacker News
TopNewBestAskShowJobs

qnleigh

2,052 karma · joined March 12, 2023

submissionscomments
qnleigh··on Google Chrome update will close the door on ad blockers
Naive question: will it not be possible for ad blockers to upgrade to ManifestV3? Is there something about it that makes ad blocking much harder. What does Manifest actually do?
qnleigh··on Why I'm Forced to Say Farewell: Google Management Has Lost Its Moral Compass
All this proves is that economic interdependence doesn't completely prevent war. Who knows how much more violent the 20th century would have been without it.
qnleigh··on Why I'm Forced to Say Farewell: Google Management Has Lost Its Moral Compass
Ironically this take is also a pretty black-and-white, cynical take. There are far worse places on the internet in this respect than Hacker News.
qnleigh··on Why I'm Forced to Say Farewell: Google Management Has Lost Its Moral Compass
I know Google's track record prior to the DOW contact is far from perfect, but is it really so hard to understand why it crossed a line for a lot of people? Why are we acting like ad tracking/targeting and developing autonomous lethal weapons are morally comparable?
qnleigh··on Why I'm Forced to Say Farewell: Google Management Has Lost Its Moral Compass
Economic interdependence is also a big factor. If you depend on someone selling you things or buying them from you, you have a lot more to lose by invading them.
qnleigh··on Building from zero after addiction, prison, and a felony
Is a success story line this still possible with coding assistants, or do they basically pull up the ladder that this guy climbed? I don't have enough insight into the job market right now to know.
qnleigh··on Ask HN: What was your "oh shit" moment with GenAI?
How much did the original apps cost you? That's gonna be direct job replacement for those people.
qnleigh··on Ask HN: What was your "oh shit" moment with GenAI?
They've been coming faster and faster for me. First I was blown away by GPT2, specifically the fake news article about talking unicorns. Just stringing together a few sentences while maintaining logical coherence was very impressive at the time.

Then it was models like Minerva that could actually solve math problems, and the discovery that LLMs were one-shot learners and could write code.

After that, the improvement felt pretty steady, with IMO gold feeling like a watershed moment.

And recently OpenAI's solution to the planar unit distance problem is starting to actually freak me out a bit.

qnleigh··on Creatine raises brain energy levels and slows cognitive decline: study
They also quote a follow up study that sounds more compelling:

> The 2026 multicenter placebo-controlled trial extending this work enrolled 240 participants with early Alzheimer’s... The intervention group showed slower decline on standard cognitive scales by about 30% versus placebo.

But there's no such study in the references section. Not sure what's going on there but I want to see the data before I believe this.

qnleigh··on AI Dark Output: The Visible Cost of Invisible Output
> During the 1980s and 90s, macroeconomic data could not detect the contribution of the emerging computer revolution. Famously, Robert Solow quipped “You can see the computer age everywhere, but in the productivity statistics.”

> Consider two scenarios, first a firm that used to buy a $10,000 HR service from an outside provider now buys that HR service for $10,000 from an AI HR provider. In that case the output still is captured in national accounts and all that disappeared was the wages and workers. In the second version that $10,000 service is now done internally for $10 of tokens. In that scenario GDP has declined by $9,990 despite the same work being done.

qnleigh··on Bay Area mom out thousands after scammers use AI to mimic daughter's voice
I think a verbal password works just fine here. But it has to be something that you are 100% positive the other person wouldn't forget, otherwise it's not effective.

Also sending this article to family members so they're aware of this kind of thing.

qnleigh··on Scientists say they've reversed brain aging in mice with a nasal spray
> Behavioral testing showed that treated models performed significantly better on memory and recognition tasks.

"Treated models" - it sounds like they're trying really hard to hide the fact that this was all in mice. From the paper:

> Therefore, using a mouse model, this study investigated whether IN administration of hiPSC-NSC-EVs in late middle age can significantly reduce oxidative stress and curb microglia-mediated neuroinflammaging in the hippocampus.

Cool! But please be honest in your press releases.

qnleigh··on An OpenAI model has disproved a central conjecture in discrete geometry
Can you describe what the reaction to these results has been like in your department? Obviously many people are excited, but what else? How do grad students feel about this? Are any professors getting worried about becoming obsolete?
qnleigh··on An OpenAI model has disproved a central conjecture in discrete geometry
> it'd be more fun to win a game if you were on the field than if you were benched

This is a good analogy for AI work displacement. Probably would resonate with some of the college students who boo'ed Eric Schmidt.

qnleigh··on An OpenAI model has disproved a central conjecture in discrete geometry
I want to push back against the notion that the math already exists in the weights, both in the practical and the philosophical sense. The LLM had to do an enormous amount of computation to find the counterexample. We know it wasn't looking up the answer from its internal representation, because the conjecture was unproven. The proof came into being when the model output it, and if they'd run it for less time or asked it something else then the conjecture would still be unsolved.

I'm also afraid of a world where AI completely replaces human mathematicians, but if we remain collaborators, then that's a world I can still feel excited about.

qnleigh··on AI Wearables Are Coming but They'll Need to Pass the Coffee Shop Test to Survive
This sounds distressing. I would encourage you to talk about this to someone you trust. Family or friend?
qnleigh··on Meta to cut 8000 employees despite $26B Q1 net income
Probably few if any of the layoffs are happening in their core AI efforts, in which case a big effect of all this it to shift the balance of their workforce toward AI and away from other priorities.

I also wonder if it is to see whether the remaining employees pick up the extra workload using AI...

qnleigh··on Arena AI Model ELO History
As far as I understand, this is exactly how ELO scores work. If a more capable show up and starts beating all the other models, it literally takes ELO points from everyone else.

https://en.wikipedia.org/wiki/Elo_rating_system

qnleigh··on Googlebook
It's kind of amusing to me how such an obvious statement like this is getting downvoted so much. I suspect most people feel this way about ads and HN readers are more bothered by them than most people.

(I hate ads too, but I think I understand the alternative perspective).

qnleigh··on Software engineering may no longer be a lifetime career
LLM's don't have to achieve perfect reliability to replace lots of work. They just have to reach the balance of reliability and cost suitable for a given task. This will depend on the task.
qnleigh··on When Dawkins met Claude – Could this AI be conscious?
> a model that was truly just 10^1000 hard-coded if-statements to respond to every possible question

That's a really compelling argument against the Turing Test. But in order to build such a machine, you would need an enormous amount of compute to populate the answers. The interesting question is then whether consciousness emerged while doing all that pre-compute.

qnleigh··on When Dawkins met Claude – Could this AI be conscious?
Yeah self-awareness is a very different thing, and I agree it's easier to see how evolution would produce this. Many apparent signs of self-awareness in LLMs are probably baked into the models at end via post-training (RLHF), where they learn to behave as conversation agents and maintain a more consistent personality. The raw model probably shows no signs of self-awareness. In fact, I'm pretty sure that LLMs learn that they are LLMs only through post-training.
qnleigh··on When Dawkins met Claude – Could this AI be conscious?
A lot of the comments in this thread point out that LLMs could be very good at tricking us into thinking that they are conscious because they operate on language; our brains are primed to empathize with what they say and imagine a being operating behind them. This is a really good point.

I'll even take it a step further; most of an LLM's training is next-token prediction on random internet content. A newly-trained LLM will just continue whatever text appears in its context window, like an extremely capable autocomplete. The illusion of an entity that takes turns in conversation and presents a consistent personality is tacked on at the last minute through RLHF. This was the transition from GPT to ChatGPT.

Any positive evidence of LLM consciousness should probably mostly be taken from the model before post-training, where it displays remarkable capabilities but shows no sign of a consistent personality, and likely no signs of self-awareness or self-understanding.

qnleigh··on When Dawkins met Claude – Could this AI be conscious?
Root commenter here: I'm... almost one of those people. I suspect the fallacy is that we vastly underestimate the gulf in complexity between a human-written algorithm and a minimally-conscious creature like a bug. Probably the light switches on somewhere between these two things.

We may also be overestimating the richness and complexity of an LLM relative to a human when we entertain these possibilities, but who knows.

qnleigh··on When Dawkins met Claude – Could this AI be conscious?
I'm assuming that you don't need to model e.g. quantum gravity effects to faithfully simulate a brain. Probably chemistry is enough *shrug.

Some people think that consciousness is related to quantum mechanics, but the laws of quantum mechanics can be simulated with a Turing machine so that doesn't necessarily change the story.

qnleigh··on When Dawkins met Claude – Could this AI be conscious?
This is a good point and I agree. I sort-of addressed it in my reply above.
qnleigh··on When Dawkins met Claude – Could this AI be conscious?
Well I'm not saying that LLMs are conscious; I'm just saying that I'm not super-confident either way.

To flesh this out a bit more, I agree that ability to communicate is not enough (ELIZA probably didn't pass the bar, even if it did kinda pass a Turing test). But that's also not what gives me pause with LLMs. It's how much information processing they seem to be doing under the hood.

It's really hard to imagine how next-word prediction could lead to consciousness, but I find it almost as hard to see why evolution did. If we can't even detect whether something has subjective experiences, then how can it have been selected for evolutionarily? The only possibility I see is that consciousness is a byproduct of some kinds of information processing tasks.* And if it's something that emerges naturally, then the line starts to get very blurry.

*This sounds reductive, but I don't at all mean it that way.

qnleigh··on When Dawkins met Claude – Could this AI be conscious?
What does ability to learn have to do with consciousness? A person with severe memory loss/learning impairment is presumably still conscious!
qnleigh··on When Dawkins met Claude – Could this AI be conscious?
It's easy, and very tempting to dismiss this sort of thing. But given how little we know about the human brain, let alone consciousness, I don't see how we can be confident that LLMs aren't conscious.

I've had a lot of thoughts and conversations over the years that changed my mind on what consciousness likely requires. One was the realization that a purely mechanical computer can, in principle simulate the laws of physics, and with it a human brain. So with a few other mild assumptions, you might conclude that a bunch of gears and pullies can be conscious, which feels profoundly counterintuitive.

I think that was the moment I stopped being sure about anything related to this question.

qnleigh··on An AI agent deleted our production database. The agent's confession is below
It seems like the most unreasonable thing happening here is Railway's backup model and lack of scoped tokens. On the agent side of things, how would one prevent this, short of manually approving all terminal commands? I still do this, but most people who use agents would probably consider this arcane.

(Let's suppose the agent did need an API token to e.g. read data).

← PreviousPage 4 of 17Next →