Guess I should mention - I wasn't even on H1B. I'm a US citizen. I feel bad for people on H1B who have to live like that and can't escape that level of exploitation. I think it hurts everyone involved.
A big part of it is that most of my acquaintances were paid significantly more than me. When they go out to eat dropping $40 on lunch and drinks was no big deal. I would imagine OPs issue could be similar. An engineer at a startup making ~75k in SF is likely hanging out with engineers who make double that.
I lived in SF and worked in tech and I know perfectly well what @maxpert speaks of. Some of the best years of my life, But the only way I could afford to live there was to live in a 1 bedroom apartment with two roommates.