The single most useful thing about ssh to me is that it connects stdout/in across the channel (this is behavior inherited from rsh). This allows for e.g.:
% (cd /foo; tar cpf - .) | ssh bar \(cd /baz\; tar xpf -\)
Or: % cat ~/.ssh/id_rsa.pub | ssh bar tee -a .ssh/authorized_keys