Most of the big-data processing stack (Hadoop, Spark, Tez, HBase etc) only really exists because adtech companies needed to process mountains of garbage logs and cookie data in daily batch jobs. So they developed big-data libraries capable of it.
But those technologies are now used pretty widely across the whole tech industry, including in the hard sciences.