"One of the dumbest sayings ever."

I agree, as my time is much more valuable than money.

"You could say that you prefer to do something else during that time and would happily pay to free it up."

Correct, it is applicable to just about everything you pay money for.