We use a philosophically similar solution at Spotify:
https://github.com/spotify/crtauth
The difference with crtauth is that you don't need an SSH server running in tandem, everything is handled by the crtauth library. Our main use case for this is for bots that need to access secure services.
Protocol spec: https://github.com/spotify/crtauth/blob/master/PROTOCOL.md