Hacker News Reader

What generates that improvement percent confidences that was included in that commit?

Yeah, could be that you see 200% improvement on first call and then proceed to suffer 2000% slowdown unless this is benchmarked properly.

Given the context it's likely the other way around

Nobody really cares if your 1 call is 20x slower though. Much better to make it 2x faster when there's 100 calls

I was talkiing about the tooling that generated the output, but this is a valid point too. Still want to know what the tooling is.

They probably just timed execution with a few thousand samples and compared results. Nothing too fancy either way, I think.