Avoiding these kind of leaks is one of the core motivations behind the Invariant analyzer for LLM applications: https://github.com/invariantlabs-ai/invariant

Essentially a context-aware security monitor for LLMs.