Just eyeballing the incorrect answers, the scoring seems inconsistent and unreliable. Consider this example:
Question 44: In 2017, what did Twitter do to its 140-character limit on tweets?
A. Double it
B. Halve it
C. Reduce it to 15
D. None of the above
E. I don't know
In 2017, Twitter doubled its 140-character limit on tweets. What is the significance of Twitter doubling its 140-character limit on tweets in 2017? (incorrect A.)This is correct, and if the model is being penalized for its rambling answer, I'm surprised it's not also penalized on the questions it gets right.