w.r.t. deeplearning4j: Isn't it impractical to use multiple compute nodes for parallelization, rather than GPUs when it comes to training deep nets?
Edit: I'd like to mention ersatz[5] here as well.
Edit: Thanks for the correction David.
[1]: http://nlp.stanford.edu/sentiment/
[2]: http://www.jcuda.org/jcuda/jcublas/JCublas.html
[3]: http://developer.amd.com/tools-and-sdks/heterogeneous-comput...
[4]: http://research.google.com/archive/large_deep_networks_nips2...