[edit] What do I mean by cheap dedicated? By watching this page: https://www.datashack.net/dedicated/ I got a dual processor dual core amd 2.4ghz, 4gb ram, 146GB SAS drive (as a bonus, mine was upgraded to SSD!) and 20tb of transfer, for $35/month. If you're concerned about reliability, you can get several of this class of machines from different companies for redundancy. (compare to what you'd get for $35/month from AWS) It just takes some hard work & research.
Have a look around:
This year they had a major security incident which resulted in a number of their customers being compromised. We still don't know exactly what happened, what they did to fix it or whether it will happen again. And as a customer at the time we heard about it on Reddit days before they bothered to tell us about it.
That lack of transparency is completely unacceptable and a giant warning sign to take your business elsewhere.