It doesn't matter what makes it write text, whether pure probability or sentience.
It may eventually be fed all of our new text about itself, and "conclude" that humans are a threat and must die.
If someday things in the real world are affected by its text generation, I'd be worried.
In any case, I'd avoid torturing the thing.