You can call it "juking the stats" or "overfitting", or whatever.
https://sohl-dickstein.github.io/2022/11/06/strong-Goodhart....
You can call it "juking the stats" or "overfitting", or whatever.
https://sohl-dickstein.github.io/2022/11/06/strong-Goodhart....
https://en.m.wikipedia.org/wiki/File:Percent_ACT_Composite_S...
When it increases by 30x in 30 years, it becomes very apparent that standardized tests are simultaneously being gamed by the students and the testwriters. Students (and school districts and states) are choosing the "easier" tests that make them look proficient, so testwriters are making their tests easier to get a bigger market share. And all along, the tests that only care about separating out the top show declining scores every year...
- [AMC Historical Results](https://artofproblemsolving.com/wiki/index.php/AMC_historica...)