But having lived here now for almost 2 years, that impression is just so wrong. It's a TINY fraction of SF, and that is not what SF is about. Next time you're here, find a boutique hotel in the Marina, or Pacific Heights, or Russian Hill, or the Mission and Uber over to your conference/meetings (the city's small enough that it's $10-$15 each way).
That's the SF that people love (or hate ;)