That's pretty much the case with all sports. Try to go skiing for the first time, and compare yourself with a champion. Fighting sports are similar, but maybe we wrongly assume there's something innate with fighting. In the end, it's all technique! at least in a sport context.
One funny thing in fighting sports, is that sometimes there are big thug-looking guys joining the class, they look intimidating and dangerous, and you realize they're just as harmless as any other beginner!