I think we can say pretty confidently they aren't pelican-bench-maxxing
Jokes asides, @simonw any plan to include a 3D model version (make a 3D model of a Pelican riding a bicycle in Blender)?
Given that Astra seems to have improved a lot in 3D modeling capabilities (and that matches my experience) I'm actually quite interested to see if/when other models catch up and how they stack against it.
Or if anyone knows what would be a useful existing benchmark for that skill.
I've not committed to that as a benchmark yet because you really need a full coding agent configured to run Blender, and I like benchmarks I can run as a single prompt/response through the appropriate API.
I have been intending to get more of a coding agent benchmark going though, so maybe this should be part of it.