It's because the word evolved during the 20th century into a mild pejorative. Similar to the word "gypsy." Occidental isn't disliked because nobody ever called anyone an Occidental in a sneering way.