You may want to train it on some new data then. The data CoreNLP comes trained with is basically yelp review type of stuff, so people talking about a product. Seems to work fine for people talking about other people too. But I think you will get much better results if you train it to actually detect trolls.