It's tedious and repetitive even when the benefit is obvious and substantial, unfortunately.

Automatic test generation tools. There's quite a few on github, but the real ones are the ones you write yourself. What you're looking to do is to run the software a few times and record tests for particular pieces of code during those manual tests.