I tend to find when someone starts a sentence with "not to be rude" or "with all due respect" or "I don't disagree", this person's subconscious is telling them "hey don't say this thing you're about to say because..."
And then the person just tells their subconscious to take a back seat and prefaces their statement with a dismissive phrase.