687 karma · joined July 8, 2026
And by all you mean 1-2 big names and a bunch of unknowns, with all other big names having no connection to this.
Were they? I haven't seen a single report mention this
I do feel that threats of catastrophic loss of control seem overstated, both in likelihood and urgency, though any argument for why this risk is not even worth thinking about will probably be overconfident in the other direction.
The other part is that this is happening because the foundational model business is both extremely successful and competitive, if it wasn't as successful the market demand would've been saturated by now, and if it wasn't as competitive a single monopoly could've paced things more reasonably from the beginning.
And this is not to say that the tech isn't revolutionary or the demand isn't there, it's simply just currently too competitive, and to avoid getting into anti trust trouble they need to involve the government.
Note this being a plausible doesn't necessarily make it true, for all I know they could have witnessed some safety incident and decided they need a pause, or maybe it's both reasons.
Scenario A: The internal logs show that the model misidentified the car as a fueling station.
Scenario B: The internal logs show the model looking up car jacking information and scanning around to confirm whether the neighbor is not present before taking any action.
I don't think it would be anthropomorphizing or inaccurate to say that only the lawnmower in scenario B regarded what it's doing as stealing, and it's an extremely important distinction to make in terms of how to address the problem, I suspect some of you are just letting how you feel about LLMs limit how you can talk about them.
What do you make of all the recent hacks and discreet message boards? That's unambiguously misaligned behavior.
Some people think this should all fall back on personal responsibility, but the way I see it, introducing highly addictive algorithms should've been regulated the same way adding addictive chemicals to food is.
Someone correct me if I'm wrong, but the work involved here is not the actual millennium problem, but it concerns versions with an added external force that the author thinks is a path that may help toward solving the harder unforced problem.