The area between Jarvis and University/York is pretty unpleasant to walk around once you're south of Front, in my opinion. Walking in the rest of the city is quite nice.
I suppose it can be attributed to the expressway being there, but shit - I dread visiting the area on foot.