Often test suites are distributed with the source to the package.

This is about including them in the binary distribution. So they are available in programs people distribute, and also in binaries for mac/windows/ubuntu etc.