It's strange. I grew up in the Bay Area (Santa Cruz and South San Jose) and am weather-neutral. I've had stints in Sweden, Portland and Arizona (all pretty extreme) and none of the climates really affected my life too much. Most of my friends are the same way. Anecdotal, but maybe the weather effect is more pronounced on transplants who don't take it for granted?

The reason I chose to move back has more to do with the sheer amount of stuff to do. And the good food :)