That depends of the era you learned of its reputation I suspect. I'm not sure I've ever heard that idea despite growing up in the neighbouring county.
Expensive != posh -- the proximity and relatively easy trains to London probably help make it expensive.