This is cool. And yes for those considering "serverless" those latencies are real world typical even apart from cold starts ;)

I use httpbench quite a bit. It's replacing CLI tools like ab, siege. And you get programmatic access to concurrent loads.

Building an enterprise-grade front end could actually generate real customers. Is there any chance you'll provide an interface that allows anyone to run any arbitrary uploaded code for testing performance?