Not even just flaky tests, but tests that don't specify enough to stop a paperclip maximizer; consider an AI told to stop the 500 errors, which blocks all users, thereby stopping the 500 errors. (Prior art: Consider the tetris-playing AI that was told to maximize how long it could go without losing, and which "won" by hitting the pause button.)