He did many things in Congress unrelated to civil rights. Those votes are not in alignment with many, who still respect him.