My observation is that it's a pretty niche ideology. Even many people who know "open source" don't know "free software". While just about everyone who knows "free software" also knows "open source software".
You commented "you could argue that someone who seriously ideologically disagrees with Stallman". I will try to make a more concrete expression of my argument, which is somewhat different than your comment.
If I'm 98% aligned with Stallman, but think that using "GNU/Linux" is a lost effort that's a distraction to the cause, and refuse to use it in my writings and talks supporting free software, would Stallman still work with me? Or would he reject associating with me, and not support my rise in the free software movement?