When I moved to Southern California I had GPS nav in my car. Being new to the area I used it on every trip. After a year or so I realized I still had no idea how to get to anywhere.
If you set your GPS to be always oriented north like a paper map despite your own changing orientation as you drive, you will maintain a better spatial awareness as you travel about the city. This way the GPS becomes a learning aid instead of a crutch.
I like to use the GPS to get my current position on the map but not have it spit out turn by turn directions.
I did it the worst way possible and didn't use either of your suggestions. I just used turn-by-turn voice and didn't look at any map.