I have not been using OCaml, but I have been using Reason / Bucklescript on Windows extensively. Other than some expectation that GNU tools like cp are available on the path, everything has worked beautifully.