Incest 'relationships' in the real world are mostly coercive, abusive relationships. Often similar to real world polygamy where young (usually highly religious and often underage) women are married to older patriarchs and young men are shown the door.
There are reasons that some things are banned, and it's not just because of inbreeding.