Short version: He's writing a book. He thinks that for the amount of debt involved, you can go do much more gratifying things in life than college from age 18 to 22. Oh, and he's writing a book.
My best understanding is that there is some correlation between successful entrepreneurs (like Bill Gates) and dropping out of college. I do not know if that correlation runs both ways. I would be very reluctant to suggest that dropping out makes you a better entrepreneur. I think it probably goes in the other direction: People who have what it takes to be good entrepreneurs sometimes skip past the silly credentialing stage and get on with making things and let the chips fall where they may. Folks who have an idea for a business but feel the credential is important and are thus unwilling to forgo college to focus on their business may never make the necessary commitment -- staying in school may turn out to be one of many excuses as to why they ultimately just won't put it all on the line. But dropping out of college in no way guarantees one will do anything worthwhile with their time/money in place of it.