Exactly! As for the driver calling to ask you to cancel, that should be on him. He should cancel, not the customer. That seems like a scam from his end. Trying to up his numbers, or keep from getting the ding from the cancellation.
Moreover, with drivers rating riders now, I’m quite sure the driver gave me a poor rating(so did I, but this exercise is just counterproductive really)