Why does it matter if you’re talking to an AI or a human? What can a criminal AI say that a criminal human cannot?
People you know typically won’t desperately need lots of money with some elaborate story that is impossible to be immediately confirmed.
If AI suddenly leads to an increase in call spoofing, that’d be a problem of the phone network that we already face with robocalls, but wouldn’t be new.
Edit: it reduces the cost of the attack and thus makes it more profitable.