there are blockers for webcrawlers. A few dozen were supplied by my neocities.org account, but I had to uncomment them