I think the idea of revering books as objects comes from an earlier time when books were rare and expensive. But now that books are abundant and cheap, it's a useless conviction. We should cherish books for their content not their physical form.
Plus, once I mark up a book it becomes one of a kind and more valuable. If I keep it intact it's indistinguishable from all the other thousands of its clones.
On occasion, I pick up books from my dad's library. His marginalia from decades ago enhance my reading experience. It becomes a meeting of three minds instead of two. I also enjoy putting down my scribbles next to his. Perhaps a few decades in the future my son will stumble on the same book, traverse the same pages, and trace the thoughts and reactions of his predecessors. For me, that is much more compelling than accumulating a family library filled with pristine volumes that make it indistinguishable from a commercial bookstore.