I bet most folks who don't frequent the site, and haven't used it over the holiday weekend will come back and not even know anything had transpired and don't feel any decline. I've used the site daily for a long time and it is fine by me. Maybe I just don't get upset that I can't say and do anything I want on the site because I know that is silly.
Shutting down creep subreddits like fatpeoplehate and others is totally fine and isn't stifling anyones free speech. No one has a right to be able to post whatever they want on a 3rd party website, fortunately to many and unfortunately to some the Internet is no longer the Wild Wild West.