It is a derogatory term. Just like I use the term "racist" as an implicitly derogatory term. Because it is.