Something I'm confused about: the entire dataset (train+test) is submitted to the blockchain (in the PAY_FOR_TASK transaction), right? So what's to stop miners from using data from the validation set in training?
Edit: I think I understand now; training is deterministic given the nonce and the winning entry is verifiable based on that. You don't have to verify the other entries, because there is no incentive to cheat if you don't win.