> That's somewhat equivalent of partially seeing the secret internal state
Not just partially, xorshift128 is designed such that the output depends only on the last 4 results. So this is "just" learning the output function of xorshift as a neural network.