The bigger problem is that they produce that are most of the time making perfect sense and then every now and then they spectacularly fail on input that is indistinguishable from inputs that gave correct answers.
I bet at a lower level, various systems in the mind fail constantly but we have enough redundant error correction to filter it out.