The opposite situation might even be worse. Pilot-in-command says you're go, but you're not keen on the weather. Suddenly the PIC is super pissed that you're not sharing the cost of the ride anymore, and you have a lot of very bad options. Pay for a ride you aren't going to take, get in an airplane in circumstances you feel aren't safe, or piss off this individual who's going to bad mouth you to everyone he knows.
It really seems like this could persuade a lot of people to make bad decisions.