At a minimum, add some caching in front of WordPress. Even a 1 minute cache of pages will result in being able to host your WordPress site just about anywhere. Throw in a CDN, and you could almost host it on a Raspberry Pi and throw Reddit at it.
This is the correct solution. Not sure why it's downvoted.