Other than that, who knows. I'm sure that various US politicians like Nixon and Reagan still have enemies even though they are both long since in the ground.
He was generally anti foreigners, anti equal rights.
He was a member of the crazy nationalist cult Nippon Kaigai that wants a return to the prewar status of the godly emperor and profess Japanese Yamato's pure race superiority. Look that up.
Wikipedia :
"Shinzo Abe [0] was affiliated with the openly ultranationalist organization Nippon Kaigi (Japan Conference). He was considered a right-wing populist and ultra-conservative within the LDP, and some media and books referred to him as a far-right politician. According to Professor Dominique Tasevski, his legacy can be defined by nationalism, historical revisionism, and a deterioration in Japan-South Korea relations."
"Nippon Kaigi [1] believes that "Japan should be applauded for liberating much of East Asia from Western colonial powers; that the 1946–1948 Tokyo War Crimes tribunals were illegitimate; and that killings by Imperial Japanese troops during the 1937 Nanjing Massacre were exaggerated or fabricated". The group vigorously defends Japan's claim in its territorial dispute over the Senkaku Islands with China, and denies that Japan forced the "comfort women" during World War II. Nippon Kaigi is opposed to feminism, LGBT rights, and the 1999 Gender Equality Law."
[0] https://en.wikipedia.org/wiki/Shinzo_Abe#Political_positions...