Height, weight, shape, pilosity, generic looks, intelligence, education, success, wealth, virility, etc. are all criteria that are used by people to judge other people and
discriminate, whether they're purely esthetic or have functional impact. Society also prizes different things in men and women. These are all forms of discrimination but I think it should be clear that they're
nothing like the discrimination of black people. Scale, intention, means, effect, all matter. A puddle isn't an ocean although both will get you wet if you step in them.
If your point is that we should eliminate any and all discrimination... sure. Although it's a far too lofty goal to happen as long as we're biological beings. But saying that "there's really no difference" between color and height discrimination is something you could and should really walk back from rather than attempt repeatedly to defend.
Every single decision you make is based on some criteria that you may not even be able to clearly define. But just because you can't verbalize why you like this person and not the next doesn't make it less of a discrimination process. Do you think that makes you the KKK?