Just create them locally on your computer and use rsync or ftp to send them to your web host.

With static HTML, you don't need any databases and it doesn't matter what type of server or operating system your host is running.