However, being looked down upon or discriminated against is one thing. Having to fear for your life and safety because they will hurt you just because of what you look like biologically is a different issue.
Take the infamous Japan for example, if you live there long enough as any non-white minority you should expect to be treated badly based on your appearance alone.
Take a white area in any US state or night time at a sun-down small town. Bad things will happen to you and the cops will be in on it. Or take driving as a minority in certain parts of the US, there is a chance you might run into a cop who might decide to frame you for some crime and at best you will spend a few weeks in jail before being set free. That can happen outside the US in say Russia for example, the US isn't special but the type of racism where you don't get jobs or get called names in public is different than being afraid day in day out or have large portions of a political party advocate for race wars, genoicide,etc...
I mean can you think of any other country where a minorities are incarcerated at a similar rate per capita as the US?
I use to think like you as well but the US is a bit special as with many things in this regard. But racism like many other evils are default settings on humans.