This has already been happening (custom voice models of a target the purpose of fraud) for (at least) the past couple of years. It just keeps getting easier and more efficient.