ParentFull threadYeri·Cloudflare: https://www.cloudflare.com/robots.txtGoogle, facebook and bbc's are surprisingly boring :)View on HN