If you install Docker Desktop with WSL2 checked, it automatically lets you run Nvidia-SMI in your WSL ubuntu environ on Windows:
https://i.imgur.com/C24EV5U.png
then sudo apt install nvtop
https://i.imgur.com/SOoCdvR.png
EDIT:
Thanks, Some people were having random problems installing WSL on their systems and I found this was the easiest solution (but based on their card models, they appeared to have much older machines.