I'm sure you can do it all with Powershell, I just don't want to switch :)
But as for getting it all installed, it's pretty easy:
1. Chocolatey [1]
2. Git chocolatey package [2] (gives GNU tools, SSH - there is also a separate OpenSSH package from MS [6])
3. Vim chocolatey package [3]
4. Consolas font (just change the DOS window properties)
5. Solarized colours [4]
6. GNU Readline (clink) [5]
[1]: https://chocolatey.org/install
[2]: https://chocolatey.org/packages/git
[3]: https://chocolatey.org/packages/vim
[4]: https://github.com/neilpa/cmd-colors-solarized/
[5]: http://mridgers.github.io/clink/
[6]: https://chocolatey.org/packages/openssh
Edit: fixed formatting, added OpenSSH package link