I think the reason this word choice is divisive is that male/female refer to biological sex, whereas man/woman refer to gender roles. A large segment of society recognizes that gender is something people are free to choose.