I don't think it is quite as conspiratorial as you make it out to be. I was speaking to an active angel investor last night. He said he won't do a deal that is much more than an hours drive away. He feels like he can't really participate (as an advisor) to a company that he can't easily reach.
It is not unlikely that many (most?) of the Silicon Valley investors feel the same way.