Full threadpostit·log analyzing the last month access approximately 1/3 of our web traffic is generated by crawler bots.View on HN