you're just increasing the uncertanity, but not drastically so. If you use your laptop during benchmarks that show 10x improvement, then your thesis still stands
Not if you were playing Crysis 3 during part of one benchmark and looking at Facebook the rest of the time.
No. To be honest PyPy is very sensitive to cache usage, so running any other program trashing the cache might be a serious problem (can lead to 30% performance degradation, depending on the load even if the core is unoccuppied at all)
I'm confused. You started with "No" and then continued with something that is either in agreement or orthogonal to my point.
That was "I agree with you" kind of no. English is hard, sorry.
Ah, I follow now. I knew I was missing something, and there it is. As somebody who writes English professionally, I agree wholeheartedly.
For the end benchmark I've used "runlevel 3" (multiuser without window manager) to perform this tasks, to maximize cache and RAM usage.
That's the spirit! You should also stop services known for spikes in CPU usage like the cron daemon and run the benchmark multiple times.