sure. But I think 99.9% of people just don't care if they're "free" by his definition of free.
If I buy a laptop, I consider myself free, even though I don't have the schematics, the moulds used to make the plastic, the development details etc.
But what if the laptop co goes out of business, and my laptop case gets a chip! How will I make a replacement case if I don't have access to the moulding details etc! Well, I don't really care that much.
It's just an odd thing to strive for IMHO.
I think one of the problems with open source is that it assumes anyone can just 'take over' some source code and fix bugs etc. The reality however is that it's not that simple.
Just like giving me plastic moulds is nice in theory, but pretty useless in practice.