This may be against a TOS, but I'm sure if you changed your User Agent to match a common web crawler you would observe... something.