Am I missing something?
Is this attack really just "inject obfuscated text into the image... and hope some system interprets this as a prompt"...?
Is this attack really just "inject obfuscated text into the image... and hope some system interprets this as a prompt"...?
There's an example of this in my bio.
However, as the OP shows it's no a solved problem and it's debatable if it will ever be solved.
The missing piece here is that you are assuming that "the prompt" is privileged in some way. The prompt is just part of the input, and all input is treated the same by the model (hence the evergreen success of attacks like "ignore all previous inputs...")