ParentFull threado1y32·I am not a lawyer but I am pretty sure a website protected with a password and/or firewall means something different from a robots.txt that is nothing more than a convention.View on HN