He's literally a multi-billionaire from his taste and vision (Yeezy fashion, music production).
Popularity and quality are orthogonal.
Kanye's music, particularly from before the last few years, has been well reviewed by critics. His shoes were popular among "sneaker heads", or people for whom sneakers are a hobby.