That's why I use --git-dir=$HOME/.dotfiles

I rename .git directory to .dotfiles in my $HOME