If a product manager has the skills and ability to do a good job but a team member is refusing to work with them due to their age, marital situation, whether they have children, etc, then the problem isn't the manager. If I was responsible for that team I'd seriously consider removing that team member.