I think CC used to provide full-text indices. Not sure though and can't find any posts on it.
11 karma · joined February 15, 2019
In the case of twitter, there is no equivalent for a per-account "robots.txt" and issues like this arise where you can't take your content back once it's copied. Twitter thread compilers should regularly check whether a tweet has been removed etc to turn into a cache and avoid these situations.