Not sure about the "ease" of writing programs that scale efficiently to 128 cores.
If we're just running several processes there's not much difference from just running 8 computers each with 16 cores.
If we're just running several processes there's not much difference from just running 8 computers each with 16 cores.
You need interprocess communication that works across machines.
You need to orchestrate the deployment of software.
Communication within a machine is much faster.