but the OP was talking about the size of the context window, not the size of the training corpus