"Seeing" starts pretty much at the retina level and along the optic nerve. Lots of signal processing and data compression going on there. I wouldn't be surprised if hallucinogens affect those areas as well.