I would suggest Octopress/Jekyll framework to serve static web pages from a VPS such as DigitalOcean/linode. You may as well use Github Pages to host your web pages if that meets your needs.

This will meet many of your needs listed.