Because the chance of random mutation to increase an IQ (or improve anything whatsoever) is far smaller than to lower it (or degrade anything).

Change randomly a random line of code in any source code, and tell me how often it happens to work better than before.

Same reason animals living in darkness lose their sight. There's a cost to keeping the hardware, and no rewards.