Yes there are. A 50 year old man cannot enter Harvard college.
Middle aged college students usually attend extension schools part of the university, but not part of the undergraduate college.
In any case there’s no strict limitation on being an undergraduate at say 60 (I believe Harvard Colleges oldest graduate was in their 80s), but it’s so exceptionally rare it’s ageism.
There’s no reason why one would need to be an undergraduate.