Maybe you do, but most of our industry doesn't and hasn't for decades. Isn't this just the next step up the ladder of abstraction?
433 karma · joined May 9, 2025
Maybe you do, but most of our industry doesn't and hasn't for decades. Isn't this just the next step up the ladder of abstraction?
I'm expecting a similar story to play out with Anthropic: The stock price will come down significantly after the IPO, resulting in lots of headlines about the AI bubble bursting. But in the long term it'll climb up again and investors who stick around will do very well.
What's more interesting is the new ability to easily create ports of old games that let you play old games legally: Bringing your copy of the original's data files and playing on a modernised engine with high-resolution, unlocked FPS, bugfixes, etc. In the past couple of months, I've seen a bunch of vibe-coded ports of DOS games for which the source code was lost.
We can (and should) try to improve AI safety and alignment, but perfect safety is probably impossible without losing the capabilities that make AI unique. Black-and-white positions that insist anyone creating or using an AI is responsible for anything it does wrong under any circumstances are also unrealistic. AI is a general purpose technology, and we have always accepted that it is not practical for suppliers to envisage and constrain every downstream use: Car manufacturers cannot prevent every instance of mechanical failure, nor can they stop cars being used in crime.
What sensitive information? Mishandled how? Which company procedures? It's all utterly vague and impossible for an outsider to form any opinion on. All people can do is guess and apply their own pre-existing opinions. E.g. if you don't like OpenAI, you assume they're lying. Who's to say they're not? There's no solid evidence provided either way.
What I really want is journalists who do the legwork to get to the bottom of stories like this: Establish sources inside the company and use them to report on the real details of what's happened, triangulating multiple accounts and leaked documents to back-up or invalidate either side's claims. Without any of that, these stories are just gossip.
We've had strong coding agents for less than a year. Anyone making such a definitive statement about how vibe-coded projects progress over time is basing it on guesswork, not evidence.
FWIW, statements like this are so patently ridiculous that it actually hurts your cause.
In order to align AIs that don't perform destructive/dangerous actions when they think they can get away with it in order to further their goals, we need to give them a superseding goal. The best, and really only example, we have of intelligences that willingly avoid destructive instrumental goals is humans, who judge each action by a moral standard and have learned a goal to have a consistent self-image as moral beings.
Absent better alternatives, trying to impart some kind of morality to AIs seems like the best approach we have to achieving alignment.
An open letter to Dario: if you mean it, give me a billion dollars!
Every time you, or any AI company releases a new frontier model, you have to give me a billion dollars. No strings attached. This will solve the danger of AI. Somehow.
But if they are saying this contaminated the model's training data with knowledge of their ideas, who's to say the model they were developing their research ideas with wasn't already contaminated through prior discussions with other researchers about the same topics?
So if contamination is proved, or cannot be disproved, and if these researchers want OpenAI to relinquish its claim to have solved these problems independently, then it would seem they also have to give up their claim to have solved them independently?
"In abstract domains such as Mathematics or Computer Science, the Sense Experience (E) may be grounded in high-dimensional topology or have other goals such as generality or minimality."
But if such sense experience is possible in abstract domains via some high-dimensional topology, why could a sufficiently advanced LLM not develop an equivalent high-dimensional topology for domains like physics and use it to make creative leaps?
This seems highly dubious. You can't just memorise the form of mathematical proofs and then produce a valid one by feeding plausible looking BS into a verifier until it works. That's like saying a cargo cult will build a working airport if it just tries enough times.
Right now we're often in a situation where the only data you have is expensive tests ran when you're sick enough to justify them, when it may already be too late.