This parallels the conversation going on in the ML world right now.
"They just so happen to look like gorillas!"
This is not okay.
I know it's just a pile of linear algebra and there's no conspiracy to screw a particular country.
But once it's brought up that your system is causing harm by increasing inequality in the world, you can't just say "But that's what the algo is spitting out!".
At least try to fix it.