Does that mean you should do stupid things and ruin your life? Probably not. But this is not about doing stupid things. It's about having the option and the option not being constrained by arbitrary things (ie who gets to decide that A is good and B is bad, A is okay, B is life destroying)
also, one thing to consider: It's mostly non-controversial that pot is harmless nowadays. The more you go back in time, the more pot was painted as wrecking your life, a gateway drug, etc. So a lot of what the effect of a drug are can (and is) hearsay + fear-mongering.