Just because people don't actively think all the time in terms of low level contexts doesn't mean that only simulating the high level contexts is a sufficient substitute for the whole process.
I think this whole concept is conflating "illusion" (i.e. allowing oneself to be fooled) and "delusion" (being involuntarily fooled, or unwilling to admit to being fooled.)
I personally don't enjoy magic shows, but people do, and it's not because they think there's real magic there.