The honest answer is i was fed up and choose the nuclear option out of frustration and just wanting to try a new toy. So yeah your right, i'll try that.

I don't think the inconvenience is that big though few secs loading page per session. The ridiculousness though kinda is, we've had years and years of all manner of crawlers that managed to behave, i've even used site rippers in the dial-up days that avoided hammering servers and fetching dupes, now the ai-bros come along and tear the internet apart, replacing it with their chats systems and generic slop.