ParentFull threadshirakawasuna·They could just ignore it, right? Or do any new rules actually require honoring robots.txt?View on HN