No GPU support => not interesting. GPUs are an order of magnitude faster. If you're doing deep learning on CPUs you're wasting your time and/or money.
Furthermore, almost any technique you use to distribute and scale training will work just as well regardless of whether the computations are happening on CPUs or GPUs.
http://research.google.com/archive/large_deep_networks_nips2...