I haven't run benchmarks but this comment provides a glimpse - https://news.ycombinator.com/item?id=38571518
VM startup speed has many levels to it. Right now, we are doing the inefficient job of having a pool though we have some items in the roadmap to fix this better.
In terms of speed up, we are doing things differently. For instance, we are baking in container layer caching natively so that users can benefit. This leads to speed ups of 2-10x depending on how the dockerfile is structured for caching.
This is just the first step - we have a very exciting roadmap :-)