I think it comes down to people wanting AI to do what we say ought to happen, rather than what we actually do. I wish the solution was to fix what we actually do, rather than have to rejigger the data, but here we are.
Young-Old, Tall-Short, Poor-Wealthy, Educated-Unschooled, ColdClimate-HotClimate, etc?
This is the same problem why your netflix recommendations just show you either the stuff everyone else is watching or the stuff super similar to the stuff you've already liked, it's hard to make predictions that are both novel and useful. There has to be room for exploring new domain space.