robots.txt have no legal validity.
The purpose of robots.txt is to guide bots away from circular links and such that would result in bogging down the site and causing undue amounts of nonsense traffic.
The purpose of robots.txt not access control.
EDIT: typo fix