Hacker News Reader

Personally this is one of the reasons I chose to go into software instead of statistics when I was a young math major. The idea that you could make a small mistake that invalidates all your work and you might not even know it until much later or even never always made me uncomfortable. With software I can write tests till my neuroticism has been placated

View on HN

If all the programmers who write tests go into industry and none of them go into academia, then the state of software in academia will be... oh, I see, the status quo.

No, they do write tests, just

1. Include the ones that passed and discard those that failed. 2. Run the tests several times and report only the best result. 3. Keep some of the details secret (data, some weird parameters, or maybe the whole repository), tweak something, run again, get some nice figures and publish a new paper.

Caltech has Millikan's (oil drop experiment demonstrating quantization of charge) notebooks. He repeated the experiment until the data fit his theory.

Fortunately, he turned out to be right.

Reply on news.ycombinator.com