but all how are all these services able to let in valid traffic? won't they simply cut me off altogether to protect my infrastructure at the cost of no access for my users?
This does mean occasional false positives.
We can barely tell humans and robots apart, and have no idea how to tell good robots from bad robots.