If the salary at the highest levels crashed dramatically, the pool of players at every level would shrink accordingly. We would probably see an effect similar to what happened to boxing: the best of the best would still be very good, but the rank-and-file that make up the rest of the sport would be so terrible that most people would lose interest and stop watching. I suspect that fan interest would hold through some level of decrease in overall skill level, but that there is some point where people will just stop watching because the quality of play is so bad (and because of the constantly growing evidence regarding the long-term health implications, which, going back to the boxing example, was another piece of what knocked boxing off its cultural pedestal).
It's just not right to encourage people to do that, and I think a lot of fans are choosing to watch something else.
Edit: Also, basketball has better economics and a more international fan base, so it's probably safe. Baseball is probably fucked too, at least in the current incarnation of MLB. But the NFL is definitely fucked.
Has the popularity of boxing been impacted by this issue?
Also, if the funnel of advertising (and thus TV) money goes away, the visibility of the sport will drop, and visibility reinforces popularity.