This is a flawed line of reasoning given that the overwhelming majority of meat eaters also eat a significant percentage of their calories from plants. It is referred to as a balanced diet for a reason.
Disclaimer: I am not vegetarian/vegan but eat one or two meatless meals per day.