I think it was just a somewhat tongue-in-cheek reference to the fact that he was a don, who don't marry.
Was there really a prohibition on marriage, or was that a side effect of dons being required to be priests (who in the CofE of course can marry). Interesting.
In general, restoration politics were weird.