Personally, I live in Rochester, NY, and I absolutely love it. There are definitely some neighborhoods that I avoid, but there are also extremely nice areas in the city with beautiful yet affordable housing and lots to do. There are all kinds of fun events, concerts, and festivals going on all year; lots of nice restaurants, bars, and coffee shops; an assortment of beautiful parks; the list goes on. The community of friends I've met here is also much more tight knit than anything I've encountered in bigger, busier cities.
I think a lot of people tend to gravitate toward extremes: I see a lot of answers in this thread pointing to very large cities, or super-rural areas out in nature, or far-away international metropolises. There's definitely something to be said for picking a middle ground, though - I feel like I get to have my cake and eat it too, and if I want to occasionally go to a Michelin star restaurant or climb a mountain, I can always do that on vacation (which, of course, is easy to fit in the budget too, given the amount of money I save by living here).