Perhaps it's improved in the last few years, but Brighton is the only place I've personally seen someone sitting on a street shooting heroin in the early afternoon.
Expensive != posh -- the proximity and relatively easy trains to London probably help make it expensive.