The redditors in /r/machinelearning have shot this idea down many times. A few common arguments:
1) It costs more and isn't as performant as tuned machines. 2) The training data is very valuable and shouldn't be shared on a blockchain and restricted to a closed network.
Maybe there is one advantage though. Crypto people have bought up all the GPU's.