Normally I'd agree, but I can't see how OpenAI has proven trustworthy at this point. How do you know they are doing it correctly? How do you know their models aren't escaping containment and training on your shit? What is it about OpenAI's operational security up to this point that has bestowed any confidence to anyone?

If the news broke tomorrow that their internal, Navier-Stokes-defeating models had actually used those private tokens, I'm sure we'd all act surprised and outraged – it'd be an egregious violation of their agreements. But would it actually be that surprising given their recent history?