"Money" has also generally been the issue for me. Not simply the money to get to and enjoy activities. The money to meet (sometimes unrealistic) expectations of physical presentation (including clothing, grooming, the time and energy and diet required to work out) and therefore feel comfortable among people who will judge you for it - including, crucially and as a black man, authorities. The money to keep up with friends who might want to do things you didn't necessarily budget for. The money to feel comfortable with all of this while managing other necessary expenses (including, for some, supporting family).

When I had a job, I definitely didn't have the money for all of this, particularly while living in a hoity-toity resort town (and particularly when it became much more hoity and toity and white during the summer). Making rent was much easier (read: possible) when I just went home every day.

I have some other thoughts, particularly about how the modern job market makes it more difficult for young people to build durable relationships at work (which, as much as legal might abhor it, is indeed one of the avenues through which many young people make friends). Might edit/reply later with those. Suffice it to say, when layoffs disrupt the already imperiled process, you end up with a lot of people entering their late 20s/early 30s with social lives that are exceedingly fragile, if they're even extant.