You can get a cheaper VPS through ramnode & $15/year atm
I guess I'd personally also mention Contabo as an affordable host in general (though their web UI is antiquated), especially their storage nodes: https://contabo.com/en/storage-vps/
For the most part, though, use whichever host you've been with for a few years (though feel free to experiment with whatever new platforms catch your eye), but ideally still have local backups for everything (as long as you don't have to deal with regulations that'd make it not possible) so you can migrate elsewhere.