This reminds me of an early ML study about detecting skin cancer from pictures with a high accuracy rate.
The problem was, that with the ML, they ended up building a ruler classifier, because most of the pictures with skin cancer happened to also have a ruler in them to measure the size.