This reads almost identical to the rationales against hiring women from past decades. Women did not fit in with the male teams; ingrained misogyny was so common. And yes, they didn't behave the same, and had special needs (they were still expected to be mothers, needed separate toilets installed, customs like having the boss over for dinner prepared by wife didn't work, weekend golf and the bloke talk was unthinkable with women along), and required coworkers to adapt and change, as acceptable behavior around the work place was not acceptable around women at the time.

Team fit shouldn't be the only criteria, and shouldn't be a criteria at all if you have a cultural problem. A company that has decided it needs to hire more women or fewer arseholes or has a staff burnout issue or high staff turnover does not want to keep hiring the same type of people, and that is what you get when you are hiring on team fit. Beyond ethical issues, a company can decide on purely economic grounds that it wants to be hiring neurodiverse workers, and that might mean losing people who are unable to adapt. And you probably want to lose them, given that there is more acceptance of the neurodiverse elsewhere and your team members will need to deal with them, even if you don't hire them yourself.