Not OP but aphant: the information is there, we just can't "see" it. So we can know how to navigate because the map is stored, it's just that we can't access it in a visual way. Note that for me the access is less detailed and also fades quicker.
As for maths: I actually have a physics PhD and am now a C++ dev. I couldn't mentally integrate anything complex. Never needed to, someone invented paper at some point ;) I'm a decent programmer I'd say, it seems to be common among aphants to be good at abstract reasoning, which I think really helps with coming up with good programming solutions to concrete problems.