Tons of studies show that weed effects emotional processing, increases risk of of sudden psychosis, and yes, even gray matter loss. [1] This idea that weed is safe due in part to its associations with "Nature" is really a social fabrication. People just fought for another thing they wanted to imbibe that wrecks us in another, not necessarily equivalent, way.
Personal experience is it's one of the few recreational drugs I can't handle as I experience extreme paranoia, rarely terrifying out of body experiences, and always an inability to speak, which is extremely uncomfortable as I deeply value my ability to communicate.