Now I know where those annoying challenge pages come from. Was planning to add CloudFlare to my site but if it comes with those challenge pages, I'd rather pass.
Adjust your basic security level to modify CloudFlare's protection behavior. A low security setting will challenge only the most threatening visitors. A high security setting will challenge all visitors that have exhibited threatening behavior within the last 14 days. Essentially off will act only against the most grievous offenders. We recommend starting out at medium.