People want to have something to fear or wave pitchforks at. It's simple mob psychology, and it's scary.
https://theintercept.imgix.net/wp-uploads/sites/1/2021/08/08...
The symbol became irresistible to that guy after watching liberals lose their minds at it. If it hadn't bothered the libs, it would have no use to him.
Semantic quibbling over the provenance of the symbol is a distraction from the violent ethos and activities of those who adopted it.
I think you're underestimating lib owning as a motivational factor for these guys.
1. An army supporting the continuation of the enslavement of black peoples.
2. A group (KKK) who would ride out and lynch black people.
3. A very small number of people who fought Nazis.
4. Neo-nazis.
1 out of 4 isn't bad, I suppose...