Intellectually, I know there's a huge difference between a programmer who has 99th percentile programming skills and one who has 90th percentile programming skills. Being a non-programmer, I don't have the tools to easily tell the difference.
This means my base instincts will tell me to work with the person who is a good programmer and speaks confidently and clearly, vs. the exceptional programmer who's shy and mumbles. That's because as far as my brain can tell, they both have the same degree of programming ability.
I work very hard to solve this bias. I make sure to focus on people's strengths and ignore weaknesses that aren't obvious dealbreakers. I try to maintain wide social circles and ask my most successful friends what standards I can use to judge skill in different areas. I pay a lot of attention to how other people in their industry judge them, vs. people in general.
What I've found is that there are two kinds of people who are really diamonds in the rough. One is people who are generally smart and have shown the ability to excel in a lot of fields, but haven't had a lot of experience in the field you're talking about. Think about a recent graduate who has an exceptional understanding of History and Psychology and is an excellent tennis player. This kind of person will usually learn very quickly and excel at jobs that demand a high ratio of problem-solving ability to knowledge.
Another kind of diamond-in-the-rough is someone who is admired by people in their field but somewhat disparaged by others. A good example would be a Salesman who always exceeds his quota but struggles with basic math. People who find math easy will typically think of this fellow as stupid, even if he's a genius at what he does.
Pay attention to people like these. It's all too easy to make a mistake like "If someone can't do math/can't speak coherently/failed high school/doesn't understand technology/uses Internet Explorer, then they must be stupid." In my experience this is almost never true-having a weakness doesn't mean that someone doesn't have a certain strength. Focus on the strengths and you'll end up working with (and hanging around) much more interesting, much more diversified people.