I can imagine this to be a problem. But I can also imagine it to solve a problem. Right now, customer support is often "dehumanised" and Kafkaesque because no single human has the full picture and all the permissions required to resolve a problem.
We're often talking to organisations with "brains" split into a thousand fragments. Having humans in the loop doesn't necessarily help if impersonating a cog is all these humans are allowed to do.
So if an AI can reintegrate this split organisational brain into something resembling human thinking, it might just be an improvement on average.