I don't know that I eat more fruit & vegetables than the average US citizen. I'm not particularly a fan of them, although we do include them in dishes that we make.
My first point is that being a vegan reduces agriculture by a great deal.
I'll also submit that it is highly likely that in comparison, due to the processing around meat, that it has similar if not more exploitation of people in its production, and not a small part of that is the sheer amount that the agricultural sector needs to grow in order to support it. They chop down the Amazon Forest to grow soy. Not to make tofu, but to feed cattle.