Eh. We exist in a society where people who perform abortions must live with people who believe a fetus is equivalent to a full human life. People who believe unbelievers go to hell must live with people who are atheists.
The tension between vegans and non-vegans is not unique or unprecedented. The only thing that's new is veganism's recent growth spurt, which has produced a lot of new converts that mainstream society is slowly learning to tolerate, and vice versa.