I competed in two different Olympic sports and although I attended the Junior Olympics for one of the (big whoop, right?) and didn't place, I never once thought I was a loser--you just look at the competition and how a mere few seconds determines the winner versus going home with nothing. People have peak days, others are just a tiny bit off. What I realized is that greatness has a component of luck to it. I figured I was lucky to be able to compete there at all. There are letdowns for sure, but you're not competing with others as much as you are competing with yourself.
ETA--Having attended the Olympic Training Center around age 16, I can't tell you how depressing it was to see 20 and 30-something athletes living in the dorms there, striving for their moment of glory while everyone else was out having fun, working, starting families, etc. I look back at that as the moment I made a very conscious choice to focus on having a career. Olympic sports aren't pro sports, you aren't getting endorsement deals unless you're in one of the "popular" sports like swimming or downhill skiing.