how did they eliminate those? are they keeping all functions warm 24/7?
how did they eliminate those? are they keeping all functions warm 24/7?
It’s impractical to keep everyone’s functions warm in memory all the time. Instead, serverless providers only warm up a function after the first request is received. Then, after a period of inactivity, the function becomes cold again and the cycle continues.
For Workers, this has never been much of a problem. In contrast to containers that can spend full seconds spinning up a new containerized process for each function, the isolate technology behind Workers allows it to warm up a function in under 5 milliseconds.
So, we've always had very low cold start times, and now we've made them disappear "inside" the TLS handshake.
Or deep dive here: https://www.infoq.com/presentations/cloudflare-v8/
(Disclosure: That's me giving that talk.)