Well, suppose I decided to be a communist, albeit one that rejects violence. Living in the United States, this would subject one to all sorts of potential problems when dealing with officialdom, even though there's no Constitutional barrier to it, unless you are using very narrow definitions of communism, and even then one could legally amend the Constitution to get around those problems.
It's not that I feel warm to communism, but that I want the liberty to adhere to an unorthodox idea should I encounter a sufficiently compelling on. If there are socioeconomic penalties for the development (not necessarily the expression of or action upon) such unorthodox beliefs, then we're in an era or soft Orwellian thoughtfcrime.