I'm talking about the one-time initial setup of the Tailscale client software.
Can you download and run Tailscale on a Windows client without Administrative access to install the software (setup the virtual NIC)? An SSH client is just a user-space app.