Hacker News Reader

It would be interesting to see if fine tuning on your KTANE test improves your results?

I may be missing something, but if you train a model to pass a specific test… isn’t it obvious that it would do better on that test?

I thought we called models with test data in their training set “poisoned”

That is how training is done. You don't train on all of your material or the tests are worthless.

If you train on any test material, the tests are worthless.