I don't know much about SF as I haven't lived there as an adult, but New York is an incredible place to live for lifestyle reasons too.
It has great food, a very high concentration of smart and highly educated people, great museums, great performance arts, etc. It's also an incredibly walkable city, which is rare in the US.
Hands down it would be my choice of city if I was a remote worker.