Similarly, while I understand why (American) football can look like 11 armored clowns randomly bashing into each other, it is arguably the most interesting and strategic game on offer by the time you understand the rules, the why of those rules, and the resulting strategies, metastrategies, statictics, etc. Baseball is also more interesting when you understand more of the whys of what is going on than just "Man hit ball with stick and run fast".
Of course there's no great virtue per se in loving to watch sports, so I'm not advocating that anybody seek this out, but if you are interested in what all the fuss is about, I recommend learning more about the sports and the rules and the second-order effects of the rules and such before writing them off. Unfortunately, I do not have any references; I did it the long, slow, hard way.
(Contrariwise, while soccer is fun to play, learning more about it has still left me pretty cold to the sport.)