Data from the past is less accurate and incomplete.
That creates a bias for recent data even if the real atmospheric temperatures have not changed. We're forced to treat the data as the source of truth only because it's all we have, but we shouldn't assume the data is perfect. In statistics, picking out individual data points is about as silly as it gets.