> OpenAI themselves has admitted a weak version of this (that prompts might inadvertedly end up improving the model). We don't know the extent of this.

I think this is being misunderstood. Codex has a toggle to allow your prompts to be included in training data. They’re saying they can’t be sure if the person had it on or off while using Codex to discuss the work.

They’re not saying that some prompts are mysteriously jumping into training data.

Also, there is a large market for AI services which don’t retain anything under any circumstances for enterprise customers.