Basically, in my ideal world, whoever builds an ugly enough building should be liable to remove it or improve it if it is deemed too ugly by a majority.

Graffiti is (partially) just the consequence of not living in that ideal world, but because of all the other problems with graffiti, I'd rather just treat it as the vandalism it usually is in all cases. No sense holding an election before every prosecution or clean and paint job.