Many municipalities and hoa's have pretty draconian expectations for your landscaping. Municipalities in Florida and Ohio have litigated and fined homeowners for that which they perceive as nuisance plantings or general nonconformity.
My former residence, while not under a hoa, did have a township restriction that inundated me with calls and mail from the city demanding I remove my front lawn herb garden and tomato vines. I had to fight the city for nearly four months before they dropped the issue, but they even went so far as to send landscapers to my doorstep to "confirm" an appointment I never made.