Yes it matters, but not for success. When you're the minority in a field, it feels good when you discover there are others from the same background who have chosen the same path as you and have been successful.