Something being potentially extremely dangerous isn't super notable. We sell cars to everyone, and that's ~ a device for accelerating a ton or more of metal to potentially eye watering speeds. Propane tanks are already approximately a crappy bomb.

I've not seen anything so far that's remarkably more dangerous than a laundry list of commonly purchased items. Most of what I hear is either some sort of far fetched "the teenagers are going to be bio-engineering designer strains of polio", or some vague fears that the AI will become sentient and kill us all that vaguely reminds me of when the Manhattan Project thought they might cause earth's entire atmosphere to enter runaway fission.

I'm also distrustful because virtually all the experts stand to benefit from convincing us unregulated AI is dangerous. Namely, it's a compelling reason to ban Chinese and open weight models that are eating into their margins. It doesn't mean they're wrong, but it does mean that they'll need to substantiate their claims. I'm not trusting them at face value.