So Deepseek gives out the correct answer the highest percentage of all SOTA models, yet is the least confident of all models?
That means a low calibration error would be a good thing, ie the model correctly recognizes when it is unsure about answers instead of confidently stating the wrong answer.
R1 is still the best. o1 drops a little (8.9)