I think a policy of having more than one person present in these kinds of meetings, especially if they are off site or after working hours, is certainly a good way to mitigate any risk as well as ensure everyone is still receiving the support or mentorship they need.
As an aside, it's always nice to hear someone who recognizes they aren't a good fit to be a manager. I'm not sure I would be good at it either but it seems that even people who very obviously don't have the personality for it tend to jump at the opportunity.