Now, I could be 100% wrong because I'm not looking at any data to back up what I'm stating next but from what I remember what you say above is not 100% true.
From the time the campaign starts until the campaign ends and the election is complete the PAC's $ can not go directly to a candidate. The problem is what happens to / with that money after the campaign is over? From what I've heard that money can go directly to a candidate (or now official-elect) with no strings attached.
Of course, I do not have a citation handy, but I've never heard of leftover PAC $ being reimbursed to those donating nor have I ever heard of candidates or a PAC donating the leftover PAC $ to charity.