The trick to understanding that is to look at the history of the personal computer and the demands placed on the CPU and supporting chipset that evolved with the changing demands of the platform over time.
The ARM systems evolved from 'system on chip' or SoC designs where everything was on one chip. And even the latest ARM server designs don't have anything like the notion of an ARM server system where you can choose from a variety of CPU skus and drop them into a baseboard socket.
That isn't to say that they won't eventually get to something like that, it is only to stress that ARM systems design is still a 3 - 6 years behind personal computer systems design. And to date it isn't getting pushed very hard to close that gap.