There are plenty of examples of AI being successfully used to emulated the email / messaging style of a specific individual already known to the target, for spear fishing attacks, and fake video and audio of family members tricking people. I think you're substantially underestimating the peak ability of AI these days