I think we only say things about the cost of time for leisure activities when it's not worth it. Example, I heard many times people saying about a bad movie: wow, I wasted 2 hours watching that