There's a non-moralistic reason to be concerned with adultery in the case of politicians and public servants, which is that knowledge of it can be used for extortion.
Likewise having a spiff 18 months ago at burning man or glasto isn't really a huge risk to security if its not a crime - would also help with recruitment for TLA's