You can pay with bitcoin if you want. Bitcoin is not fully anonymous (but for that matter, neither is cash-in-the-mail since TLAs store photos of the outside of envelopes, but I digress). Kagi itself doesn't have the data needed to de-anonymize the transaction, so it's as anonymous as you can reasonably expect.