I’m not sure how much this tells me about a model’s coding ability though.

It might correlate to design level thinking but it also might not.