4,521 karma · joined July 12, 2013
There are still a lot of issues with coding that require intervention. Just recently, I had Astra detect a minor bug in an HTTP client that resulted in it deciding that the best approach would be to spend 1800 LOC on implementing its own from scratch. Some other time, Opus 5.5 was trying to tell me that test runs on a small to mid-sized application would take another three weeks until they would be fully finished.
But seriously, the fact that this started as Crypto-adjacent should have immediately disqualified them for serious use.
Opus is at least actually usable even on the small plan. The main downside is its insane writing style, but 5.5 seems to address that somewhat. Otherwise, you can just use your $20 OpenAI plan to have Luna de-slop Opus' prose, which seems to work fine.
The reality is that the current approach to AI safety is little more than a fig leaf, but you also won't be able to put the genie back in the bottle, because the technology is simply too powerful to abandon. There is always going to be someone developing it further from now on.
So, the real question is what a novel and actually effective approach to AI safety looks like and how to get there.
> Consider that most PhD theses were never good. How often do you rush to read a PhD thesis? The vast majority of them are painful to read. You learn little if anything.
So, it sounds like nothing of much value has been lost.
I think what he really complains about is that AI is starting to show that the emperor called academia has no clothes. So much of working your way through that system has always been about being able to master largely pointless rituals.
Yet, the people on the inside have no interest in making any improvements, because academia has always been institutionally conservative. But now AI is starting to put pressure on them to rethink their way of doing things, and they really don't like it.
The point is that the same thing could have happened just as easily if you had selected targets based on the faulty data by any other means than an AI model.
Why would they possibly want their largest customer to flounder?