Why not host the site on S3?
Edit: plus I might need to add some dynamic content...
As for trouble you've had with AWS, I'd encourage you to take a second look at S3 specifically. It's been pretty bulletproof for a long time now.
It's not. A company I worked for recently had a 2TiB S3 deployment for archiving insurance documents and the amount of hoops you gave to go through for it to be reliable is incredible (no uploads or downloads are guaranteed and sometimes randomly fail for a while).