This is true, but Heroku is not the only provider of services like this, and some of the same limitations and costs exist throughout the ecosystem.

I would disagree that renting physical machines is going back to the 2000s considering nearly every large company is doing this.

Just because the trendy hipsters of the internet use the cloud, doesnt mean its modernizing things, and anyone not doing it is a dinosaur.