It's not that useful for a person to be able to read an analog clock either, but if a supposed-genius came to me and confidently gave the wrong answer, it would say something about their strengths/weaknesses in general.
The whole point of these models is they're meant to be able to generalize fairly well, not just answer questions the got trained on.