Texting Robots: Taming robots.txt with Rust and 34M tests | Hacker News Reader