I don't have the numbers at my fingertips, but growing animals for meat generally requires growing lots and lots of feed stock. Many multiples more than what it would require to feed humans directly.

So because we want meat, more and more industrial agriculture has to happen to grow that meat. So yeah, I think having an industrial meat industry has more environmental impact, than just having industrial farming in the absence of the industrial meat industry.