Could you expand on what you mean by "I very rarely trust the author"? Isn't using their work a statement of trust?

Source or binary, you are still embracing their description of tasks for an automated machine to perform very rapidly.

If you are wary of what they have done, it's true that source is somewhat more accessible to examine than machine code, but for any non-trivial program source is still quite expensive to evaluate.