Has anybody tried mozjpeg? https://github.com/mozilla/mozjpeg
It works much better than any of the alternatives listed here, I'm surprised noone mentioned it yet.
Here is an image compressed to the same size with
mozjpeg http://m8y.org/hn/12597098.jpeg jpeg.io http://i.pi.gy/AP8v.jpg