I think aerodynamics and the social importance of stature are bigger problems. When I was younger, as a reasonably tall person, often there was still good leg and headroom as a driver in boxy (or at least, less streamlined) compact or even subcompact cars. Now its rare in anything not an SUV (and even compact SUVs often aren’t great.)
Yes. I literally couldn't fit into some of the smaller cars.