Yes, you can use a paper atlas. I have an 8-year-old car with GPS, and a 34-year-old car without. I bought a map book for the 34-year-old car, thinking it'd be a "period accurate" way of driving it; it's anachronistic at best, and frustrating at worst - can you read the street signs, and did you drop your compass under the seat? In the 8-year-old car, I can hit a button, say "Navigate to (an address)" _while driving_, and it figures it out.
Some of these I do on principle (only pay with cash, avoid loyalty cards, etc.), and I accept a compromised UX as a result. Your mileage may vary, depending on how much you get out of these things, but the immediate impact of them seem generally negative.