Any operations that rely on server-side compute/data must margin for nondeterminism. I would put in a loading indicator just to cover the outliers.
Local (client-side) operations are a different matter entirely. Either precompute the result for common operations or optimize for speed!