The CFAA says knowingly. Negligence is by definition an excuse for that.
I think OpenAI would be very reluctant to let this go to a place where the reasoning was part of discovery.
These guys would be screwed if they were operating under the EU AI Act.
Unless there is a statue that is on point criminalizing the actions here no one is going to jail. I expect there will be laws, but until then it isn't illegal.