- Abstractions are the enemy of performance. You can't get high performance through many layers of abstraction. This relates to my previous point.
- Algorithmic complexity matters when dealing with large data sets. Abstractions can hide the true complexity. (e.g. the famous string append example from IIRC Joel Spolsky).
So the key to high performance software is:
- As close as possible to the hardware.
- The right data structures/layout (taking into account the hardware).
- The right algorithms.
- Measure properly and optimize.