Sort of like knowing what the complexity of an algorithm is - so you can know if your solution to a big-data problem is going to scale.

According to the author, you need to know this in order to understand "how Google works," because the PageRank algorithm is described in terms of finding the principal eigenvector of a particular matrix.