Absolutely not. There is no enforcement mechanism to punish them if they chose not to enforce the listed building rules.
(I'm a policy opponent of historic preservation, which is a major impediment to housing reform, but even I don't pretend that it simply doesn't exist.)