Hacker News Reader

What's to stop people just inserting bad test results? Seems like it could be really unreliable/dirty/bogus data.

BTW here's my testing :D http://axod.net/browserTesting.png (OSX+Firefox/Safari/Opera, XP+IE6, XP+IE7, XP+IE8, XP+Chrome/Firefox, Ubuntu+Firefox). Thought it might make my macbook sluggish, but it just carried on regardless :)

View on HN

> What's to stop people just inserting bad test results? Seems like it could be really unreliable/dirty/bogus data.

Pretty easy, just run the tests more than once (on more than one client). If you get caught giving bad data then you get banned - seems simple enough.

What about tests that intermittently fail? Race conditions etc.

That sounds like a problem with the test suites themselves, not TestSwarm or any sort of execution mechanism. For jQuery's test suite we've put a lot of work into making sure that the tests run stable and the results are easily repeatable.

There's a big difference between one test randomly failing and someone submitting completely bogus results.

Reply on news.ycombinator.com