Yeah! Sadly, if you wanna do actual Python (3.x?) stuff on aws you're better off rolling your own or paying premium to "have it all solved" on heroku :((
I pay $16/month for Heroku. Is AWS really that much cheaper?
By far. I use lambda as a public API for my sites. One site has 4000req / h (at peeks. Not much, but it's an api after all) and I only pay some cents.