First - wordpress core does version control itself and offers one-click update for core files that are updated frequently.
Second - wordpress website consists of ever updating database (that is hard to version control) + set of custom files (like custom plugins, themes, uploads, images, media, etc...).
It does not really make sense to version control wordpress-based website although it makes perfect sense to take care of backups, especially comprehensive off-site backups in case of hack-attack or crash.
For that I use backupbuddy plugin (not affiliated, just grateful customer). It allows you to automatically create unattended, complete, compressed backups for your whole website: core files + your files + database. All in one piece - without you lifting a finger. Plus it auto-uploads your regular backups to chozen destination like amazon S3 or another FTP server and allows you to keep, say, last 10 backups.
This allows you to accomplish two very important things (that git does not do):
1. You may restore complete website from scratch in minutes - including full database structures.
2. You may copy your website to different domain and it will automatically update all URL's from old to new URL - again - in minutes.
That's a perfect tool for the job.
Thanks for putting tutorial though - I love git and use it often for separate projects.