ParentFull threadbaobun·Mind sharing a decent robots.txt and/or user-agent list to block the AI crawlers?View on HN