That's essentially what happened when XChat (IRC program) started to charge for windows builds.
I suppose the only way it could work is if there is a special incentive to buy it. Some video game companies do this, they have the engine open-source, but all the assets are proprietary.