He isn't perfect, he said something insensitive in the Epstein causa, now all kinds of ridiculous allegations and warranted criticism gets mixed into a toxic cocktail, which doesn't allow anyone to move forward productively.
If RMS accepts his cancellation, he basically caves to wrongful accusations. If he stays, we can't move forward and get work done because of the drama and all the viable reasons why he shouldn't be a central, public FSF spokesperson anymore.
Plus, everyone really just wants to see the FSF fail anyway, for some reason.