1. Would we prefer they didn’t disclose? I would not. And I also don’t believe they’re making them up. 2. Regulation does not have to provide an advantage to these major players. Regulators do not have to be stupid. 3. This is exactly the scenario AI researchers and theorists have been positing for decades, and it’s worth being on top of it.
To 1. I agree that they disclosure is better than non-disclosure. Then again, aren't they using their models in a mode seems to statistically allow for 'rogue incidents'? These are not bugs, after all, but normal statistical behaviour of their product.
To 2. Well, that really depends on the regulations. In fields highly complex technoligies with a large contact surface to risk like medical devices, airliners, rockets, regulations are indeed a hindering factor for smaller players to get hold of the full vertical development potential of their product. AI could become a candidate like that too - imagine some multi phased "AI internet trial" for this kind of technology, no more risky open weight model being allowed to access the internet.
To 3. You are referring to the high development velocity and impact, right?