Hacker News Reader

Fun the article:

"The GeekBench running score before changing the location to France is 286,632. However, after changing the location to France, the running score is 298,321."

I have a hard time caring about a 4% difference in performance.

View on HN

Conditions aren't even controlled enough to measure the difference. Phone would have to be at exact same temperature, exact same time since boot, same radio conditions, laying on the same surface at the same temperature and with the same ambient air flow and temperature.

If I was doing a test like this I'd run the benchmark a large number of times (at least ten) in various (not necessarily strictly controlled) typical usage scenarios. Ideally there would be a variety of handsets of the same model too (assuming variance between those is small). Then I'd filter for outliers and take a mean. I like this kind of testing, because you account for confounds that may only appear in a single highly-controlled lab setup, and won't reflect the results that people are expected to see when they use their phone in a typical way.

Reply on news.ycombinator.com