For me this means two things - there is no way child will recall events from first couple years of his life. So there is no need to try to show new places, make him excited with particular event/thing. But in the same time, events happening in these early years affects brain (and whole body) development as a whole, so it is very important to make baby feel connected, safe, curious, etc.
Or even simpler - first couple years define "North/South/West/East" directions and then later brain develops within few "degrees" of this initial path.