Your free market part is where you'll find the clash. Any anarchist would say that a free market is inherently oppressive. The only place a "free" market would work is in a mutualist economy, and even then, that requires worker ownership over the means of production.