Before everyone gets up in arms about this, consider that this search is (for now) using simple keyword matching and isn't an AI that can understand sentences.
If you search for "woman with man" you'll get mostly white couples and the like.
Adding "white" anywhere prompts the search to look for the words "man", "woman", and "white". Images of random white couples aren't labelled with "white" in the alt-text or metadata. Images of mix-raced couples often mention "white", hence... the counter-intuitive behaviour.
This is a bit like adding "Earth" to a search term. Practically speaking no pictures taken on Earth are labelled as such, so the matches will tend to have a space theme to them.