ANNs are among the few kinds of programs that perform significantly better on small problems with exaflops than with teraflops. Gurobi, LS-Dyna, or American Fuzzy Lop will produce only marginally better results as you scale from a closet full of computers to a warehouse-scale computer. GCC or linear regression won't even work marginally better.