Not that I buy into the whole caveman fad, but isn't there evidence that the switch from hunter/gatherer society to agriculture came with a decline in health?
Basically, what I'm saying is that the truth about nutrition and caveman diets are conditionally independent given currently actually-known science about nutrition. If we didn't have science, and all you had was cavemen observations, that might be valid, but we do, so it's not.
(And by "currently actually-known science" I mean very basic things like that we can't make iron from scratch so if we don't eat stuff with iron in it then we get sick, and same with some amino acids, and same with noticing that if you eat 20 cheeseburgers a day you get fat quickly. Not stuff like whether fat is bad or good.)