I was under the impression that he was in the committee. Why should his wife leave? I don't understand.
Primarily because he is accused of improperly getting funding from the Academy and she was accused of enabling and profiting from this as well as blocking any further investigation into the matter.
There are also accusations that she prevented the Academy from looking into earlier accusation of sexual harassment against her husband, but that is secondary.