good point, but i guess they could differentiate between
want to know how to code (9/10 individuals)
willing to learn how to code (1/10 individuals)
I like the idea of some simple 'can you follow instructions' coding examples to get the basics out of the way (parenthesis, braces, int x = 1; etc). Make this test be the gate to taking up a humans time, and alter the difficulty of the test as you need to throttle.