Obviously I'm generalizing, but your (or anyone else's) remote employees may be the smartest of the bunch or even in the world, but if they are not exposed to outside influences and are satisfied in their own locales, they will remain good/great loyal employees but will never (again generalizing) become entrepreneur. Otherwise, why would you be in the SV if you could do it remotely.
So, if this remote model keeps on evolving, then obviously it will have a negative impact in the long run on SV ecosystem, since these smart loyal employees remain just then and never become entrepreneurs.
However, I think this model only works till companies reach a certain size and I do not believe that companies can scale beyond a point on a purely remote workforce. So, overall I think SV and its ecosystem is safe.