Pick up the phone, keep silent for 5 seconds. A human on the other end would say something or you would hear background noise. If you don't hear anything, hang up. This works because the auto-dialers that call centers use listen for you to say something before starting the robo-dialogue or patching you into a meat-talker.
This does work currently, but I worry for when we begin to see LLM agents that assess the victim for gullibility before transferring to an available, practiced con artist.