How are you 'spammed to death' by people like Alex Jones? You can easily just block him and or ignore his posts. I've been on Twitter for a decade and have never seen posts by Jones, even before the ban.
It was never about what you just described. It's not that you don't want to see posts by Alex Jones, it's that you don't want anyone to see posts by Alex Jones.
This IS a freedom of speech issue.