The other huge advantage that you almost touched on is tex files are text, so you can source control them. This is particularly important if different people are working on different chunks of a document. You can kind of hack around this in word, but it's a giant pita.