That's a lot of ARM64 power in one platform.
It depends on the type of ARM core and the manufacturing process. If it has 24 A53 cores then it wouldn't beat a 4 core desktop CPU from 2012. If it has 24 A72 cores but a manufacturing process older than 28nm then it still wouldn't be competitive with anything on 14nm or better.
Same goes with most long-running VPS'... bursts of activity here and there or once a day or whatever.
Being able to run those workloads on cheaper cores that consume far less power would be a huge win. Not all workloads would be a good fit, but those which are, this can be big.
Amazon isn't just providing ARM CPU servers because of customer demand, and nor is it just to get leverage with Intel. That's not the way they tend to work. They're providing them so that they can leverage them in-house as well. Amazon just likes to take the position that what is good for the goose is good for the gander. If it's good for them, there's bound to be customers that will find it good for them also, and as you sell it to customers, you get to those advantages of scale much quicker.
Medium term, I expect Intel to look much more innovative than current. Long term, we’re either all dead because the robots won or uploaded to the cloud hive mind once our contributions to the universe outweigh our costs.
Might not make a difference if you attach them to spinning disks or something, but you can really turn the thing into a wall-plug sort of thing and never worry about it again.
if it's active 24x7, then hard-drive overshadows both ATOM and ARM CPU in terms of drawing currents.
ATOM supports multiple native SATA ports and it is still hard for ARM to catch up. Marvell is the only ARM vendor does nice ARM+SATA but its chip is hard to find, plus it is used in low-end NAS devices while ATOM is in the mid-range, it's more for the cost-saving instead of power-saving though.
I was attracted by ARM lowest-power in the last, until I realized hard-drive is the one consumes most power and ARM does not do well with non-multimedia IO.
WD Red 10TB maxes out around 5.7W [1] under heavy read-write activity and can use much less when idling.
Intel Atom is typically in the 20W range for the parts commonly picked for NAS solutions, but can go as low as 8W too [2] and again when idling would use less.
I don’t think they have anything <5W which would directly support your statement the HDD uses more power than the CPU.
[1] https://www.wd.com/content/dam/wdc/website/downloadable_asse... [2] https://www.anandtech.com/show/11144/intel-launches-16core-a...
Big memory for zfs arc would help too.