If you want to use an agent for scraping/automation, you would need to supply it with auth credentials. So permission is required by default.