I would expect withdrawal from almost any medication for any chronic medical condition to be worse than baseline.
I’ve been allergic to milk for at least 15 years. I didn’t know it until 3 years ago. Now that I’m not ingesting a toxic substance every day, any accidental consumption has an extremely bad reaction.
It’s similar with my bipolar medication. Now that I don’t spend half of every day trying to not kill myself, I don’t have the tolerance I used to for paranoia, psychosis, and compulsive thoughts.