The previous comment was to describe the experiment settings.
AutoCodeRover currently generates patches. Auto-generating high quality tests can be a parallel effort and another direction to explore. These efforts can eventually be used together.
The value I get from copilot is the ability to code faster, not the ability to code.
The patches are tested against a test-suite. So, if there are tests, we welcome them, we definitely use them to validate the patches.