Switch advisers or quit. Everyone I know who's ever done different in this situation has regretted it. 3 years of the prime of your life is worth a whole lot more than a middling recommendation letter.