HOAs are pretty famously restrictive of free speech (house color restrictions, yard sign restrictions, political activism restrictions), and free association (visitor restrictions).
Their are some speech restrictions that governments apply to historic structures, but you would have a hard time as a government trying to register the name of every visitor to a residence, or restricting hours that visitors can come, or how long they can stay, but those are all things that HOAs try to control.