- sexual dysfunction
- loss of emotion and creativity
- drowsiness
- insomnia (including real fun stuff like night terrors)
- fatigue
- nausea
- tremors
I'd hardly call that safe or manageable.
With even the most potent psychedelics such as LSD, on the other hand, there's merely a one in thousand chance for severe side effects.
I'd go as far as prohibiting the prescription of SSRIs for all but the most severe cases (such as a severe depression where the patient is actually suicidal). For everything else these drugs are commonly used for, e.g., mild depression, OCD, or IBS, there are other - in many cases better - options with far less devastating (if any) adverse effects.