But don't they just "call" from a different number? Or a random number each time? There's no real verification on the number being called from - its specified _by_ the caller a lot of the time.

So unless the phone company starts banning phone companies that don't enforce correct caller id, it won't do anything.