"With all due respect" is a double-insult.

When someone says "With all due respect...", they'll inevitably follow it with an insult. In that case, the person is therefore also implying that the recipient is due NO respect since they're insulting them. Boom, double-roast. Maybe obvious, but apparently not to me... with all due respect to me.