1. In the real world, security resources aren't free.
2. Security decisions are made by users.
3. Humans will engage in risk compensation [1]
4. Setting policy doesn't change people's brains, it just tells them what to do.
5. It doesn't matter what you intend, it matters what users actually do.
The upshot of this is that any security policy that is highly visible and highly inconvenient will reduce your security, and has to have a substantial benefit to justify its cost. You can say "I'll do stupid port reassignment tricks, and I'll also mandate that passwords are forbidden, and require that private keys be managed properly" but at three in the morning when the whatever is overdue and not working what you're gonna get is:
I'll just do password auth with root:root, nobody ever hits port 24601 anyway. Besides, look at this page [2], using a strange port makes me invisible like the Predator and makes me four thousand times more secure! I really want to believe this so I do.
Also, subverting scanners is an anti-security move, not a pro-security one. Scanners are a helpful tool to identify what the hell is running on your network. Your security efforts have to find every hole, the bad guys only have to find one. Don't put yourself at an even bigger disadvantage by making your systems harder to analyze.
[1] http://en.wikipedia.org/wiki/Risk_compensation
[2] http://www.danielmiessler.com/blog/security-and-obscurity-do...