A map is by definition drawn to scale, having a scale on the map is what makes it a map. We may maintain proportions but by removing the scale, it simply becomes a polished drawing with zero intuition of distance.
I am old enough that I navigated forest/mountain treks with a compass and topographic map as a teen. To me not having a map scale when navigating to a new place feels really disconcerting.