This is now the 4th distributed deep learning solution built on AllReduce/MPI (after Baidu, Facebook, and IBM). There seems to be convergence on AllReduce/MPI/Inifiniband and synchronous distributed SGD as the way to scale-out distributed deep learning. Interesting.