I don't think that's really OP's point. The point isn't that 1 calorie for me = 1 calorie for you. We know for a fact that the digestive performance of people can vary greatly, and caloric use varies greatly also depending on person and activity level.
The high variance is really besides the point, which is that if you are gaining weight, you are consuming too much for your current situation. You can either work to expend more, or reduce your intake, both of which are perfectly reasonable options.
There is no objective measure for eating too much, but it's also trivially easy to find out if you're eating too much for you.