You could say the same about a lot of crimes. Prostitutes, hitmen, scammers, drug dealers, a lot of professions are inherently hurtful for the society. Heck, you could say the same about banking, insurances, real estate, utilities: a lot of people would be out of a job if theit companies were honest. Entire industries rely on some degree of scamming. And yet we still complain about dishonest banks, lack of competition, etc.

Stallman's views are pragmatic: some people would lose their job but that's the price to pay to get closer to an ideal society. That's not more extremist than socialism.