The Wikipedia page of PyTorch does list C++ as a language. And you can just check the code. It's C++.

CUDA is C++, Fortran, and C, plus anything else with a PTX backend.

However the main language for CUDA is C++ since version 3.0.

Documentation is available on NVIDIA website.