> archive.today operates under a "f### you" policy.
They are initiating a save on behalf of the user(a "user agent"), and thus are not a robot, so they don't need to respect robots.txt.
They are initiating a save on behalf of the user(a "user agent"), and thus are not a robot, so they don't need to respect robots.txt.
You mean they don't need to respect copyright law? So it would seem.
If a user wants a legal copy, they can choose File -> Save Page As. The copying isn't the problem, the reproduction without ads or paywalls or respect to the owner's copyright is.