Texting Robots: Taming robots.txt with Rust and 34M testsstate.smerity.com2 points·Smerity··0 commentsOpen articleSaveView on HN