Texting Robots: Taming robots.txt with Rust and 34M testsstate.smerity.com6 points·Smerity··0 commentsOpen articleSaveView on HN