It really depends on what kind of stuff the datacenter runs.
I know of datacenters where almost all the code running is Java. For those kind of datacenters, so long as JDK supports ARM (which it does), I can't see why it would be such an uphill battle.
The uphill battle is really for sites who run lots of closed source COTS software, especially that which is written in C/C++/etc, where moving to ARM needs support from the vendors and the vendors might hesitate due to the amount of work involved. There are sites where close to everything is either open-source or else developed in-house in managed languages (Java, .Net, Python, Ruby, PHP, JavaScript, etc), and those sites are likely to find it a lot easier.