I absolutely agree with you. Speed shouldn't play any role in ranking. However in regards to relevancy RankBrain is going to eventually train itself to push the most relevant/respected results. Will have to wait and watch how it spans out.