He may not be the 20th fastest driver. F1 is determined greatly by the car the driver is given. He may be the best driver (which I think would hurt even more).
Kubica and Nico Rosberg are good examples of this. Both used to race against Lewis Hamilton in lower levels of motorsport and both used to beat him. However neither Kubica or Nico have been given a truely championship winning car yet to prove themselves.