I also used to think this, then I realised https has far better performance, particularly for high latency connections.
A big repo clone from Github to here in Australia takes about half the time over https when compared with ssh. I'm not sure if github has region-located repos.