There's no way I would be able to detect if this was AI from the examples alone. If I got a phone call from a malicious agent using this tech, I probably wouldn't realize it. My plan is to ask a challenge question about a shared memory with people I personally know, if there's something suspicious about a call. I don't know how else to prevent it. It sucks to be this suspicious, but I can't help it.

There's so many potential scenarios. One scenario: An AI voice trainer trains on someone's social media video posts and get a pretty perfect copy. Then SIM jacks the target's phone number and calls pretending to need help. AIs could be used to mock ransom people, request bail money, ask for a change on a production server, etc.

People with high public visibility are likely targets, especially if they have money and or power. Impersonating them to subordinates would be an easy means of a social engineering attack.