I think they're a great place to meet like-minded people, form friendships, find potential co-founders, grow your network, get inspired by people some of whom are likely to be world's best at what they do.
Another thing is colleges force you through a rigid system of semesters, courses, and exams that takes most of guess work out of the learning. Besides, I'd wager one needs a disproportionate amount of patience to be disciplined enough to follow their own curriculum of learning regardless of accessibility and availability of content.
I am not saying the current system is the best humanity can do, but: https://en.wikipedia.org/wiki/Wikipedia:Chesterton%27s_fence
University is such an important part of development overall that it really shouldn't be skipped. It's a shame that they've become overrun with stupid SJW/feminist nonsense these days, but I think it's still overall extremely valuable. You can't replicate the university environment at home.
Not only that, you'll be looked over for many opportunities when compared with people with degrees. This isn't entirely unfair, given the justifications for university above, but it is a little. Unfortunately that's just the way it is, though. If you can't beat 'em, join 'em.