It's also not entirely clear if the property owner was ever the owner of the art itself. There's a difference between posession and ownership, and while the former is 90% of the latter, that leaves 10% up for grabs. From this pov, the case is maybe comparable to someone finding a Picasso that someone forgot on their front yard, and immediately destroying it.
But, in general: yes, if your property somehow becomes valuable for society in some way or another, that may entail new restrictions on your use. Landmark and similar designations for historically valuable buildings come to mind. When some endangered species starts breeding on your property, you may no longer be able to turn it into a parking lot.
Property rights just aren't as absolute as people like to think, nor are they not subject to change. It's obviously in society's interest to provide for robust protections of private property because it creates incentives to own stuff, and to be productive in order to do so. But these rights are just a tool that has proven extremely useful to organise our economic activity. There are always competing interests, and societies have to find a balance that maximises total value while remaining fair to each individual.