Assuming things about individuals based on group membership is a key part of racism, sexism, etc. Why would anybody be worried? Because people do it all the time.
Would you run up to a lion or a tiger in the wild and try to hug and kiss it? I'm guessing you have a stereotype of big cats as dangerous predators, and you'd steer well clear, even though there are countless friendly lions and tigers in captivity that have never hurt anyone.