Here's my response: nerds focus on long-term optimization whereas jocks focus on premature optimization (in computer science speak, think "Big O" values for 10,000n vs 2^n).

As a result, nerds are seen as low value at the present and subconsciously remind jocks that their maximum values are relatively low in the long term.