My problem with a lot of these competitions, particularly the high-reward ones, is you've got people duking it out at the 4th or 5th decimal point for the top few spots. At that point, you're not even competing for best generalizable algorithm, you're competing for 'algorithm which happens to fit the holdout set exceptionally well'. It's overfitting at a distance.