Learn the concept better, not an exception to an incorrect rule. It seems like the model architecture just isn't good enough.
As for encoding enough rules to handle things as well as a human, what things? Humans don't work with infinite knowledge so there must be a set of rules (however large) that would be "enough".