San Franciscans can (and do) make all your same arguments against you moving here: the city is small and getting over-crowded, real-estate prices are going through the roof, etc.
But San Francisco, like Switzerland, is part of a larger economy which benefits from freedom of movement.