Right, if your tastes line up with mainstream cultural production, you're probably all set wherever you live. I happen to find it odd that people are interested in recapitulating the same music from the 18th and 19th century over and over again irrespective of what happened in music in the past 100 years (from serial music to minimalism, spectralism, post-minimalism, Wandelweiser, whatever, not to mention electronic music), but it is what it is. Not that no contemporary music happens in smaller cities – I know of a lot of great stuff in St. Louis and Minneapolis especially – but it usually scales with the size and prestige of the local universities and doesn't extend much past there. If your interests are more specific, you might get stuck with a few events per year.
That's actually the most important thing from my perspective. Somebody called me a hipster, but what I love about having access to a huge array of contemporary art, music, etc. is that it gives me the opportunity to see a lot and really understand what it is that moves me and that I can express myself through. As I learn more, my tastes become more specific and "obscure." On the flip side, knowing more also helps me appreciate more different things on a new level.