GPU cluster? You might need to tweak the pytorch code, but you can disperse across multiple GPUs very easily with pytorch.