The problem is the one of scale and time waste: you are asking recipients to decide whether your email is mass-spam, commercial unsolicited email (also spam), something they subscribed to using a dark pattern (prechecked checkbox), something they subscribed to on purpose (and how long ago). To top it all off, some use those unsubscribe links or embedded images to track and confirm how real a recipient is. And many an unsubscribe link is simply broken.

You have to accept the reality that in very few cases people want these emails, so you are asking them to expend the effort in deciphering origin, purpose and viability of unsubscribing for the few where it will work.

If you are in the legitimate email business, you should design around this reality.