I think all OpenAI needs to do is scan physical newspapers and OCR them. No ToS to agree to, and no ToS on print editions.
> If you download some copyright material somehow and don't share it with anyone, there is no caselaw that says anything about it.
this is still a violation of the law. you cannot download copyrighted material against the terms of the copyright holder (like downloading a movie or album).