Oh yes I understand, I'm not saying you should give it free reign I'm just trying to understand the alternative.
So your needs would be roughly met by creating a new email under your business domain (like you would for a new employee: agent@example.com, let's assume you're using Google gsuite), and then using chatgpt connectors with that inbox and gdrive. I understand you don't want to set all of that manually, but is that final state close to what you're envisioning?