Let's say we eliminated all agricultural use of animals tomorrow. All that would accomplish is one-time shift the point on the continuum that the earth and society can support.
The real problem, and the real elephant that no one wants to address, is the human population size.