If you own a building you have the right to demolish it and erect a new one. Even if you let someone put graffiti on the walls, that is not a contract to let the graffiti stay there forever.
Moral rights in works are big in Europe but were largely unrecognized in the U.S. until the passage of the above law. It's a kind of copyright, and like copyright generally not contingent on a contract to make it enforceable against someone.