The counter-argument is true, though. I have a server that I'm able to log in via SSH. I just backed up one of my repositories like so:

    sircmpwn@homura ~/s/K/kernel master> ssh irc.sircmpwn.com git init --bare kernel
        Initialized empty Git repository in /home/sircmpwn/kernel/
    sircmpwn@homura ~/s/K/kernel master> git remote add backup irc.sircmpwn.com:kernel
    sircmpwn@homura ~/s/K/kernel master> git push backup master
        Counting objects: 4735, done.
        Delta compression using up to 8 threads.
        Compressing objects: 100% (1765/1765), done.
        Writing objects: 100% (4735/4735), 7.62 MiB | 650.00 KiB/s, done.
        Total 4735 (delta 2954), reused 4699 (delta 2930)
        To irc.sircmpwn.com:kernel
         * [new branch]      master -> master