You are truly free according to the license and the law. That fact has nothing to do with how people will treat you if you choose a decidedly less free license like GPL.

Honestly, this is like complaining that people got upset at you for bringing a crying child into a restaurant, despite the fact that it's perfectly legal!