To each his own, but I feel like that's kind of overkill. I use maps to find new destinations, but it really only takes a small number of drives to that place (often relative to the distance traveled and how often I go to that area) to memorize it. Eventually, it's more work to open the app than it is to go by memory. For me, using Google Maps is indispensable for learning new areas. I see no reason to make it harder for myself. Not ever getting lost is nice too -- what if you end up in an area you'd rather not be?
If your goal is to challenge yourself, then it would seem like a worthwhile pursuit.