Hacker News Reader

IIRC perl tested new releases by running all the unit tests in the CPAN library, waaaaay back when.

They still do and investigate each failure. If the end result is that the library is “wrong” tickets and patches get sent to the library maintainers.