You can benchmark reliably by warming up the JVM and disabling garbage collection.
https://www.ibm.com/developerworks/java/library/j-benchmark1...
https://www.ibm.com/developerworks/library/j-benchmark2/inde...
http://www.ellipticgroup.com/html/benchmarkingArticle.html
Java now ships with microbenchmarking helpers: