Because he was true to his craft. Norm was what's known as a "comedian's comedian" - the furthest thing from a phony celebrity. Norm understood 'funny' in ways most people do not. He valued comedy over being famous. He spoke his mind with no concern for political correctness, but did so in an intelligent way. That's why his (more famous) peers - Dennis Miller, Conan O'Brien, Jim Breuer and others all regarded him as a 'genius'.
One of my favorite exchanges between two recently departed greats (caution strong language): https://www.youtube.com/watch?v=Q2IQbeAr_b8&t=240s