It's actually the opposite of what you're saying. I can 100% legally do all the things that they're suing OpenAI for. Their whole argument is that the rules should be different when a machine does it than a human.
Your ability to regurgitate remembered article that is copyrighted does not make your brain a derivative work because removing that specific article from the training set is below noise floor of impact.
However reproducing the copyrighted material based on that is a violation because the created reproduction does critically depend on that copyrighted material.
(Gross simplification) Similar to how you can watch & read a lot of Star Wars and then even ape Ralph McQuarrie style in your own drawings but unless the result is unmistakenly related to Star Wars there's no copyright infringement - but there is if someone looks at the result and goes "that's Star Wars, isn't it?"