PuTTY's pretty much relegated to the emergency usb key these days. Runs on pretty much any Windows and without installing, but not really ideal for heavy use imho.

Cygwin + urxvt + clusterssh is the choice of Windows-mandated champions.