I still don't think "enterprise" customers' data have enough training value for an "over-eager PM" to bother with them. An over-eager PM obsessed with AGI, no less. I'm pretty sure more training on corporate slop is not the path to AGI (even less so if you want "aligned" AGI...).

Also, while I do agree that Anthropic's internal controls are unlikely to be on the level of AWS's or Azure's. I'm pretty confident they're good enough that random PMs aren't going to get access to things like that, especially for use in formal projects. Especially since "safety" is Anthropic's other obsession, which means "safety" data are going to be watched.

But anyway, we seem to be agreed that retaining stuff that used to get flushed early is a risk, and every copy is a risk, and sending it to more companies is a risk, regardless of the fine points of how things might go wrong.