I would never badmouth a manager on my way out the door. There's no point to it and anyone I am talking to may or may not be a sympathetic ear; in any case, if they're still there, they still need to work with that individual and it's really no longer my business.
"Dream Opportunity" or "Better Pay" are easy explanations that nobody will question. Best just to leave it at that.