Well one reason was because before 1978 you couldn't really invest in the S&P500, unless you had the time to manage a portfolio of 500 stocks. And back then most people laughed at the idea.
It's only very recently that people have started to realize that it's a good bet.