For example, one could drink one cup of olive oil daily and get ~2000 calories into your body. You would probably start suffering immediately on that type of "diet" because 1. your body isn't going to run on pure fat forever, and 2. your digestive system isn't going to process that amount of olive oil effectively.
Therefore it's not helpful to just say "Calories in, calories out" without actually looking at what you're eating.