Different people have different tastes. Yes, I do find it interesting to walk through unfamiliar buildings in real life, and I'd find it more fun to go through a realistically designed level even if that meant e.g. the pacing was a bit uneven.
The same is with wastewater treatment plants, etc. And, if you're targeting realism, size might be an issue.
That said, there are games that are thoughtful about this, such as doorkickers or heist.