I wonder if any scammers would spend the resources banking on the 1/1000 chance of guessing the three numbers correctly.
If you call a thousand people, odds are that you'll be able to convince one of them you're from the bank. At that point, what are the odds of engineering them into giving you money?