"The Fall of Public Man" argues that we actually used to be more political and had to "put our cards on the table" so to speak. This would be as opposed to now, where we are very much able to hide our positions if we so please.
I don't know what polite circles would be, but I suppose some sort of aristocracy? Certainly gentile society in 1780s in France were not scared of expressing heavy political discourse in public. Nor were the rich Romans.
Edit: And just to be clear. Rich people may perhaps only speak politics with their closest friends, but they certainly act politically with the use of their capital. Imitating them by shutting up has no point and is detrimental to a democratic society.