Refined Input, Degraded Output: The Counterintuitive World of Compiler Behavior
dl.acm.org
dl.acm.org
As a vaguely related similar idea, once upon a time at a hardware company we had a regression suite that failed if our chip was less performant than a competitor’s. But that test suite was largely hand crafted. The ability to generate these cases randomly is super cool.
It even git bisects to the commit introducing a regression