Agreed. One could however use a nonconfidential placeholder for the sensitive information and then replace it with the real information while revising the ChatGPT output.
So say you work for PharmaCorp and you are developing a new drug even if you turn the name of the drug into a code name and you ask OpenAI to write an email about say a failed or successful FDA approval process that’s more than enough for someone to take advantage of it and for you to get fired over it too…
And overall there is a reason why the USG has their own private AWS zones…
It will allow you to use the inference model and possibly even train it further on your data without having all the inputs that are going into ChatGPT right now serve as future training content.