Maybe he just doesn't care that much. Inconvenienced, evidently, but to stake a personal dislike towards a human being for this seems unwarranted.
I mean seriously, stop for a moment and think if "I don't dislike the guy who runs the company that inconvenienced me and I think things may turn out okay" warrants the association that the person who feels like this would be sexually gratified by his wife sleeping with another man.