This bothered me, until I realized that I should be reading books by people with whom I disagree. The oddity of it is, one of the great things about his books is that they show perspectives much more alien than mere human political differences.
If you feel bad about supporting him financially, remember that he only gets about a dollar for each book you buy. If you borrow it from the library, your contribution is even smaller.