Did you checkout Hashicorp Vault for this? More here: https://www.vaultproject.io/docs/secrets/ssh/index.html