To be fair, if you are a libertarian, many people claim the libertarian moniker but then say very illiberal things; check any comment section of Reason when there is a black person killed by a cop. It is getting very hard for people outside your group to identify what libertarian means anymore because of that.
A similar thing is happening on the left I think, but since it is my group, I might not be as mindful of it. The same might follow for you.