I didn't mind him that much. He stands out more than people like Ensign Ro, or uh...hmm. I guess that speaks volumes.
It helped that he and Deanna showed up in Voyager. I don't want to knock therapy here, but I felt that she was effectively tolerating him as a decades-long patient at that point...