If you already deploy your code in AWS, I would stay there. Even if you get moderately proficient you will expand your resume.

If you want something a bit easier, Vultr or Digital Ocean are both ridiculously easy to spin up a server and has all the stacks you mentioned as well as hundreds of ready made images / apps. Less worry there with over-spending.

Very easy to spin up a server and deploy a CMS or host files etc. They also make a newb friendly product called Lightsail.

If you are worried about waking up to a crazy bill, 2 solutions for that. 1. setup a billing alarm for 1, and 2 use a credit card with a low limit or even use a prepaid Visa card.