There is absolutely no reason for these logs to exist.

Run LLM in an enclave that generates ephemeral encryption keys. Have users encrypt text directly to those enclave ephemeral keys, so prompts are confidential and only ever visible in an environment not capable of logging.

All plaintext data will always end up in the hands of governments if it exists, so make sure it does not exist.