I took buspar for like 4 years because it basically didn't scramble my brains the way other anti-depressants worked and I could say I was 'cooperating' with treatment -despite getting no benefit from it.
I had no issues getting off of it; not to say that other people don't either -they very well might.
I'd say a mild benzo withdrawal and a severe SSRI withdrawal can overlap, but SSRI withdrawal doesn't give people seizures or last for years.