Consensus is an extremely time-consuming thing to build, and it's extremely important to be aware of when there exists a consensus, where there isn't one, and what the consensus is.
It isn't an appeal to authority fallacy, it's a form of deferral to expertise, and it's one of the most important heuristics we have.