I find that quickly grasping a new architecture is easiest with a graph-based diagram first. Then code for details. All with the goal of internalizing the information processing steps. Not memory allocation per se.
In my mind, how the network implementation allocates memory is a different question.
But I think both of our desires just reflect our jobs, our interests, and simply how our brains conceptualize things differently.