The second problem is: how do we recognize these outliers? Take for example, Larry Paige. The problem with 'especially if I've never heard of you before' is demonstrated here. People are never claimed to be really smart until they've done something noteworthy. This, however, is the classic illustration of hindsight. We deem them smart because they have done something smart, not because they are. Therefore, would it be fair to ask Larry Paige those questions at the time that he was founding Google?
Furthermore, pg has an entire essay on why smart people have bad ideas: http://paulgraham.com/bronze.html. Therefore, even if there are people smarter than you, that is not to say that they will have that brilliant idea instead of you.
An example to that point is Drew Houston and Dropbox. Many people, arguably smarter, had thought of that idea before but Drew was able to execute it in a way that no-one else had thought of.