Looks like I am mistaken. We're taller than we have been for the past few hundred years, but there is evidence of some earlier humans having similar heights as modern humans. There is no mention of the cooked/raw status of those particular ancestors' diets, though.

I don't have a particular reference, just piecing together the non-trash results of googling 'diet height' and 'history of human height'.