Thanks to this article, I can finally put into words what bothers me about "Copyright infringement is theft"!
Yes copyright infringement share some of the properties of theft, but they are sufficiently different that we shouldn't apply our intuitions about theft to copyright infringement, just like we shouldn't apply our intuitions about theft to taxation.