I think for these use case a SSH server in Go would be way simpler such as https://github.com/gliderlabs/ssh