Simply encrypt the data and upon “deleting it” instead delete the encryption key. This is similar to concerns about backups.
But in many cases the whole reason systems use these structures in the first place is so that there's transparency and public verifiability.