Currently, we are validating inputs from a human written database, which is continuously being expanded with new user inputs and new images. One image is used for validation, and the other is used for expanding the pool.
23 karma · joined September 27, 2011
Currently, we are validating inputs from a human written database, which is continuously being expanded with new user inputs and new images. One image is used for validation, and the other is used for expanding the pool.
You're right about certain images having easily distinguished objects-of-interest. In the future, running a routine to weed those easy ones out will stop any being solvable by bots. And also, as with any other captcha, paying other humans to validate themselves for you will always be an issue.
We validate users' inputs against a pool of manually-entered data. Because we collect a pair of annotations for each submission, one is used to verify the user, and the other is collected against an un-annotated image. As annotations are collected for new images, they are synthesized to expand the pool of annotated images.