However, libraries do have an exemption to the ban on renting music recordings (after the broad availability of audio cassette recorders, congress made renting music illegal, but libraries and schools can still loan them out).
In UK certain libraries can archive (British Library) following a recent change in the law, IIRC. People wanting to access the archive may only do so by physically visiting the library.
AFAICT archive.org are flouting copyright law around the World already, they should continue to be cautious about assuming rights IMO.
That would prevent the issue of domain squatters with robots.txt files in most cases, and offer the public a means of challenging such ownership requests (and freeing up the content on archive.org) if they desire.