I can get in and out of my large nearby grocery store in 10 minutes just fine and they have everything I could possibly want. I'm not price-sensitive and that's the real difference between that store and Aldi, completely different customer cohort.
ALDI's entire brand image is "lower price". That's why people go there.