In mainstream IT, you'd usually set up a Hadoop or Spark cluster on the machines and then write your code to run against one of those. What's the advantage of this approach over those?
Automatic vertical scaling without changing applications.
One needs to rewrite apps in order to get the advantages of Hadoop/Spark/MapReduce in general, and not all problems are solved by simply doing that.. It is a different thing/paradigm, really