I did get the sexual side effects but because men often come too quick it can be a blessing as much as a curse, personally I found it took longer to orgasm and when it did happen it was a much more complex and richer experience with a definite periodization I haven't had before or since.
When I was taking ADs I did have problems I blamed on the ADs that really had to do with the "non-drowsy" antihistamine I was taking crossing my blood brain barrier anyway.
When I did stop ADs I tapered over a month and the physical effects were not bad at all. It was the beginning of a time of personal growth that I can look back on now and think it worked out great but was challenging for the people around me for a while.