Well, I didn't want to get into the details here, but yes, that's part of it. :-) He's also been criticized for not actually telling jokes when it is his material, being/attracting the worst sort of humanity, etc.

Just think of him as a comedy aggregator, something like a real life Digg/Reddit/etc. :)

A worse insult would be calling it the 'Carlos Mencia of frameworks'.