Hell, being able to effortlessly switch between PyTorch and Numpy/SciPy/sklearn/skimage has been so helpful for the project I'm working on. That and I have tensors in later layers whose shapes depend on the training of the previous layers.
Rad! Do you have any examples (or literature) that explains when this is beneficial?
[1] http://papers.nips.cc/paper/893-a-growing-neural-gas-network...