Sometimes governments have to deal with the weapons made by their enemies and that gets them stuck in an arms race.
Companies don't have to do that. If they're getting into actually dangerous territory, they can stop as soon as they want to.
Companies don't have to do that. If they're getting into actually dangerous territory, they can stop as soon as they want to.
If you don't believe that, or you don't believe that the frontier labs believe that, then sure, it makes no sense. But they probably do. The people at these companies literally dedicated their lives to building this specific thing that, up until people had to make tradeoffs between "that looks risky" and "that looks useful", virtually everyone agreed would be a dangerous technology.
What apparently many people on HN failed to appreciate is that the thing that makes it dangerous is the fact that it grows in utility.