Ah interesting. Thank you very much for sharing the illuminating results.
One question I had - was the judgement blinded? Did judges know which models produced which output?
One question I had - was the judgement blinded? Did judges know which models produced which output?
But that is a good point. Perhaps it should be mapped to something unidentifiable.
Nonetheless you've convinced me to try an even wider variety of models, thanks!
In fact, this makes me think I should add this as a feature to my AI dev tooling - compare responses side by side and pick the best one.