This might be a good argument for keeping tests as a separate repository. Which would bring a lot more problems of its own, though...