The "short and harsh" cliche is a gross generalization. High rates of infant mortality and childhood death skew the lifespan data such that for these that survive childhood the average lifespan is not so starkly different than ours (though there is a wide range depending on time and place).
And the harsh thing also depends. The Kitavans for example are well documented to have lived moderately active lives with much leisure time and plenty of food. One tiny example of course but they are far from the only ones. So it depends.