The key is that Heroku is trying to support all major web app frameworks, whereas GAE only supports the GAE framework.

The tradeoff is super interesting: using their framework allows them to hella optimize the instance for you, but you're pretty darn stuck with it :/