This is correct behavior in that the models are expected to choose one of the multiple choice options and not write prose answer.
https://github.com/manyoso/haltt4llm/blob/main/take_test.py#...
So the above answer would have been correct were it not for the fact that it said "doubled its" rather than "double it".
Without seeing the log of answers marked correct, I'm skeptical that GPT4All, which seems to produce rambling prose for all of its incorrect answers, is actually picking one of the multiple choice options the rest of the time. It seems like a model could get 100% 'correct' just by repeating back all five options.