Calories in vs calories out is simple thermodynamics, human nutrition is complex biochemistry. The real question is, why should anybody have to count calories? Is there a way of eating that leads to the same level of satiety with fewer calories?
Why is food different? We know the human body is adaptable to an incredible variance of conditions, including the fact that we know that if anything, prolonged caloric restriction seems to cause adaptations that _increase_ lifespan. So what's the objection to counting and measuring?