"The researchers had the deep learning machine and 200 human subjects at Amazon’s Mechanical Turk crowdsourcing facility answer the same verbal questions. The result: their system performed better than the average human."
Mechanical Turk represents the average human?
And did they just ask the Turk subjects whether they had a bachelor's or master's degree or not as proof that they had bachelor's or master's degrees? Could you count on that being accurate?