Cache associativity, conflict miss. When too many memory addresses
which are far apart map to the same cache lines while being used and reused in quick succession, causing cache evictions.
Scott Meyers had a very good talk which contained this information: <https://youtu.be/WDIkqP4JbkE?t=3614>
This is an effect of access pattern rather than size, but some access patterns are dictated by size.