^ This exactly. A half-decent used Thinkpad can be picked up for slightly north of $120. And it will have 4-8x RAM and at least 4-5x CPU performance. And you own it! The only thing you potentially miss out on is: uptime SLAs ("reliability") and a higher-speed internet connection.
You also might miss out on a public IPv4 address, but that's whole 'nother issue... FRP (fast reverse proxy) is a decent workaround for this.