Not bleeding across "all that much" might well be true, though I disagree since it's kinda the whole strength of the human brain applying learning from one area to another, that's why we're more intelligent than animals and have been more adaptable to new problems. You're also thinking about this in terms of conscious decision making when in our day to day lives we rarely sit down with an open mind and properly think about things.

But even if it is not all that much, it's still there. A million people having a 1% shift in their views due to language adds up. That's why we're seeing groups of individuals who aren't racist/sexist somehow reach answers that statistically do appear to be.

The specifics of which uses are neutral or not is the next debate. Step 1 is acknowledging that language is something that feeds into the "nurture" side of how we think, especially since language is such a large part of our learning during early brain development. With that in mind, it's something that should be debated and selection of words should be considered.