There are plenty of choices... in addition to the ones mentioned below, you might want to just rent a low-end dedicated server, where the hardware is guaranteed to be repaired if defective (make good offsite backups). Performance will be higher in most cases (dedicated CPU and high RAM).
e.g. https://www.wholesaleinternet.net/dedicated/ (blue order buttons are in stock)
Intel i3 chip with 8GB RAM and 500GB disk - $20/month .