As far as where the "weird" is in this city it's in the paths less traveled. For instance last weekend several folks let me ride their horse a few blocks on the East Side while we were drinking (horse included). If you spend all your time downtown or in the more 'affluent' parts of town it's just like any other city.
Overly saturated music scene making it difficult to get paid, overly saturated labor market (students) making it difficult to get modest employment, terrible traffic congestion, quickly rising cost of living, and, this is the hardest to describe, an atmosphere permeating the place of superiority mixed with some of the worst customer service I have witnessed.
Basically, instead of complaining about those things which I noticed over the course of a couple/few years of being there for an obligation, I left, and I'm happy I did.
Between the University, the anecdotes about life on KUT, the food trucks, the transvestite running for mayor every year, places like the Alamo Drafthouse, Rudy's, and Chuy's (all places with a very distinct atmosphere), the city has a very different feel from what you see in many cities.
One thing that I didn't mention but thought important (at the time) was Austin was one of the first places in Texas to institute a smoking ban. In restaurants, I thought that made sense - both as a former waiter and cig smoker - but when the ban started applying to bars and live music venues, I thought it was stupid. Oh, so I can kill myself with this poison water, but off to hell with the stinky, heavily sin taxed tobacco? Pffffft. That right there clued me in that Austin couldn't be the live music capitol anymore, because musicians like to drink and smoke, and the ones that don't can play coffee shops or church camps, of which there are plenty of in Texas.
And while I do have fondness for Alamo Drafthouse, it was kind of a one-off thing. Rudy's isn't remotely close to the best BBQ in the area (Franklin's) and Chuy's is, well, tongue-in-cheek referred to as 'white-people TexMex with extra grease' because it's just kind of middle-of-the road. This is kind of the overall issue with Austin, in that it's got this image and reputation of being unique and clever, but really, the things it's known for aren't actually top flight. Austinites pretend they are, but long time Texas residents know better.
I know a guy that moved to Michigan from LA. He said the same. People have a vision of California that dates from the 50's before the traffic, cost of living, and pollution got bad. The only thing nice about it now is the climate in his opinion. From what I've read and seen (a week in SF) he's about right.
But you can't really judge all of it from LA. California is huge, and LA is a small but uniquely artificial, plastic-y place, inhabited by pretend humans. If that's a problem for you, you're not going to like it. San Francisco has its own unique bullshit factor that you may also not like, but it's not the same culture as LA.
And the climate is getting worse (thanks to global warming).