I like the approach. I think we will need a lot of tests like these in the near future, comparing AI performance on its actual edge cases rather than on the standard stuff we test it for right now.
Hallucinations are a big one. “Obedience” is the next one that comes to my mind (how willing or unwilling the model is to comply with requests).