TensorFlow seems to have better multi cpu/gpu support than Theano.