I know that, but in doing so you prevent yourself from ever using Sign in with Apple
But otherwise, you're right, any website that wants to accept Sign in with Apple will almost certainly be agreeing to Apple's TOS for Sign in with Apple I presume will stop you from blocking this service.