We've all heard of the bus factor. Software project isn't a one-man show. There's no shortage of brilliant pioneers handing the baton to someone else or just sliding into obscurity for any number of reasons (e.g., got bored, found another passion, started a new project, gone off the rail, etc.). People no longer care about ESR's opinions, and that's OK. There's no reason FSF should need Stallman's continued presence - it's a software advocacy group, not a cult.
I just find it frustrating that Stallman is considered beyond reproach, because he wrote something great decades ago, when his contribution in the past 20 years or so was hardly irreplaceable. Almost makes me wonder if he's being held as champion because he is an asshole who can't talk to women without creeping them out.