> regulation should focus on ensuring the safety of AIs once they are ready to be put into widespread use
What would you say to a simple registration requirement? You give a point of contact and a description of training data, model, and perhaps intended use (could be binary: civilian or dual use). One page, publicly visible.
This gives groundwork for future rulemaking and oversight if necessary.