If you have a server, some cheap VPS will suffice, you can host a private git repo there without installing anything. Run this on your server:
git init --bare foo.git
and then on your PC you can do this: git clone user@yourserver.com:~/foo.git
It's probably a good idea to make a separate user account on the server for it, though.