You can, you just need to download the maps for offline use. Google maps makes it easy:
https://support.google.com/maps/answer/6291838
It's very useful for navigating crowded touristy areas, remote nature preserves, sports/music events that jam the towers, etc.
Some more specialized apps also support doing the same thing with other types of maps, like USGS quad sheets.