There is a YouTube video about a content creator who got a huge AWS bill out of byte spider (bytedance's scraper) indexing his site incredible numbers of times.
Or maybe just don't host your stuff in such a way that any internet user can bankrupt you just from sending GET requests?
If GET requests increase my AWS bill, does that make them not idempotent any more?
This sounds like a scoping issue
This so much. While it's annoying to waste resources for nothing. All I really had to do to make this a non issue is upgrading my VPS to a slightly larger box.
If I would pay per requests I couldn't sleep anymore
On the other hand the amount of traffic he's mentioning is about 3.4 requests per minute which is effectively background noise. They're probably getting much more hits from actually malicious scanners than Bing's misbehaving spider.