It only shows up if the email has a List-Unsubscribe header set.

In Gmail it will appear as a banner underneath the row of buttons