It's the latter. The server is just abstracted away. As far as I know lambda is just docker containers running on EC2.