If the human activity involves doing something reCaptcha-/mechanical turk-esque then that's likely the point: incentivising development of systems that game this would likely result in novel AI models/tech