Does this apply to vegetarian Japanese men? Does this mean vegetarianism is considered a negative (at least among men)?
It's not even a word denoting vegetarians, but rather herbivores. A vegetarian is called 菜食主義者 (saishoku shugisha), not "soushoku" anything. "soushoku danshi" comes from "soushoku doubutsu", or "herbivore".