The first amendment makes you immune to government consequences, but free speech in general makes you immune to consequences in general.
If a really bad thing is imposed on me when I do X, then I'm not free to do X. Otherwise we'd all have the right of free bank robbing (despite going to jail).