PyTorch uses CuBLAS [1] under the hood, among other libraries, so basic linear algebra ops should be fast.
You might also look at CuPy [2], especially if you like NumPy.
[1] https://developer.nvidia.com/cublas [2] https://cupy.chainer.org/
You might also look at CuPy [2], especially if you like NumPy.
[1] https://developer.nvidia.com/cublas [2] https://cupy.chainer.org/