I once worked at an organization where we programmed in Common Lisp. Several other programmers in other parts of the outfit didn't want to join our team because they thought having Lisp on their resumes would hurt their future job prospects.
My response was if you really think about life that way, you wouldn't fit our team, and if those are the kind of employers you'd consider working for, you really wouldn't fit our team.