all carbohydrates are empty calories. if you fully eliminate fat and protein from your diet, you will wither and die. if you fully eliminate carbs, you'll be fine.
For some definition of "fine", at any rate. Outside of groups like the Inuit who eat a lot of organ meat to compensate, we don't have a great idea of what sort of long-term nutrient deficiencies you may accrue by eschewing all fibre and carbohydrate-based foods.