[1]http://pitchfork.com/news/56459-aphex-twin-speaks-on-his-new...
[1]http://pitchfork.com/news/56459-aphex-twin-speaks-on-his-new...
There's an important distinction between "I don't like this", and "This is not good". Most people fail to make that distinction - they think that if they don't like something, it must be bad. Taste and quality aren't particularly congruent. (As a corollary, sometimes we like things that are actually bad.)
Regarding quality, subjectively speaking individual composition/talents/efforts tend to influence one's opinion of the work seen/heard/etc. This is why music does, in some avenues, resemble a competitive avenue in the collection of skills and techniques. For a not-insignificant number of people, Kanye's music is subjectively bad in quality, which is irrespective of popularity.
It's not like he painted over the Mona Lisa. You can still go listen to the original Daft Punk song if you prefer it - it sounds just the same as it did before Kanye sampled it.