Isn't that the default? I don't think I've ever done a paper that wasn't in LaTeX...
It makes rendering mathematical notation very easy, also automatically tracks indices, references, labels, etc. I can even embed csv data to display as a table with a few lines of code!
It's also pretty straightforward to break down the paper into various folders and documents and import them all in a master .tex file, keeping your figures and data in their own folders too.
Can't imagine doing all of that in a bunched up in a word doc...
I mean, you can even do all the building in a container, so I often check in my work, push, and the CI builds the paper and makes a release depending on tag/branch.