Also, performance isn't only about the time it takes for something to run and whether that will impact the user, but is also about resource usage.
Those milliseconds the user won't notice are still processing that is wasted and could potentially be used for something else