In university, I was shocked to learn in a database class that CPU costs are dwarfed by the I/O costs in the memory hierarchy. This was after spending a whole year on data structures and algorithms, where we obsessed over runtime complexity and # of operations.

It seems that the low-hanging fruit of optimization is all gone. New innovations for performance will have to happen in transporting data.