The "nazis" who came out in VA recently are a tiny group with little support. One moron carried out vehicular homicide and is being dealt with appropriately by the law. If he hadn't carried out those actions though I'm sure your narrative would be the same.
I hope both groups are suppressed in equal measures, and I hope those carrying the hammer and sickle are dealt with as equally as their comrades carrying swastikas.