This reminds me of a talk about Evolution of Code at Facebook [1]. One of the first architectural restructurings (and still the major driving factor behind later changes) was the switch from sequential memcache_get to parallel memcache_multiget.

[1]: http://www.infoq.com/presentations/Evolution-of-Code-Design-...