If you listen to people like Eric Raymond, open source is all about quality. "Many eyes make all bugs shallow", etc.
If you listen to people like Richard Stallman, free software is all about users' rights: in some cases free software may be of higher quality than comparable proprietary software, but that's just a welcome side-effect -- what matters is that it respects users' rights. In this view, free software would be worthwhile even if it was technically inferior to contemporary proprietary software.
Or to put it another way: if Eric Raymond one days wakes up convinced that Open Source is technically inferior, he must drop it in order to remain consistent with his own justifications. If Richard Stallman one day wakes up convinced Free Software is technically inferior, he will remain committed to it, since technical quality was never his primary goal.
I'd say that's a pretty big philosophical difference!