Caches.
Xeons and the like dedicate much of their transistor budgets towards larger caches.
If you take that budget for caches and put it towards more execution units, you get the equivalent of Xeon Phi which is a lot of Pentiums built on today's fabrication processes.