Thanks for this key insight, but I don't see how it's relevant.

The point, which I'm very far from the first person to bring up, is that the actual purpose of vague concepts like "culture fit" is to be a wildcard you can use to exclude anyone without having to critically examine or provide an actual reason. How you personally justify having pink hair not being a "culture fit" to yourself doesn't change anything about that. What it does change however is that you now no longer have to explain that you're not hiring someone for their hair color.

There's no need to invent hypotheticals, by the way. The people I've heard asking how they can stop getting denied for "culture fit" in interviews have one thing in common and it's being >40 years old or a woman.