[flagged]
See “Virtual machine warmup blows hot and cold”. The authors run a variety of benchmarks (with a pristine methodology) and find 43% of them provide “bad inconsistent” results.
Paper summary: https://blog.acolyer.org/2017/11/07/virtual-machine-warmup-b...