Your may have been thinking of peyote, which is somewhat endangered, and widely poached.