Completely unqualified thought, but I think it has to do with how you organize information in your brain. Are you spatially oriented or do you think in lists?

I'm a chemist, and I definitely think spatially. Creating images of physical objects in my head and reorienting them is a major part of my job, and the "memory palace" has been the most valuable memory tool I've found.

I can't think if there's an extra set of papers on my desk. I tend to organize my tasks using the physical space on my desk, so the most urgent item is about 3 inches from my keyboard at any time. I start to get anxious if too many things pile onto my desk without intentionally organizing them into priorities.