I linked bash to bash.exe and was able to start it however everything from /bin was failing with:
The application was unable to start correctly (0xc0000142).
Turns out it doesn't work when I start bash by double click bash.exe but it works if I start it from cmd.exe.