dbaio

This is how we handled this in the FreeBSD infrastructure. https://blog.sysopscafe.com/posts/ai-crawlers-hammering-git-... It has been running this way for a month, and the workload is fine. I hope it continues this way.

suffering with it as well. why can't they just `git clone` and do their stuff? =)