if the provider gets popped doesn't the binary get popped too? then simply use an LLM to reverse engineer the binary and get the key?
I think siblings are correct that the more widespread this is, the less effective once every dump is run through a "also look for keys in the binary" step.
That way read access to your infra provider is not sufficient, it requires an active component.