Full threadfrankwiles·Have had several clients hit by bad AI robots in the last few months. Sad because it’s easy to honor robots.txt.View on HN