Psychedelics might reveal to you that the neat little reality that you thought you had all figured out is a lot stranger and different from from what you thought it was, that your understanding of it might be all wrong, and that your place in it might not be all that cozy and secure. The experience could put everything in to question for you.
A lot of people feel threatened by that, so they try to push it away, lock it up, turn it off, or dismiss it.
Contrast that reaction to that in some other societies with a long tradition of psychedelic use. Psychedelic experiences there usually confirm the world view of the society, and tend to be very positive and accepted.