I am not making a two wrongs make a right argument. I argue that grains are pervasive in our society and have no noticable ill effects. You strawmanned by claiming soy has way higher phytoestrogens than other foods. It's not true. It is just more studied due to its increasing popularity. Lignan forms of phytoestrogens are in potent concentrations in common cereal grains.
https://www.researchgate.net/publication/24284429_Phytoestro...