> Calorie density doesn't make a meal unhealthy.
That's right.
> Can we decouple the idea of "healthy" from calories?
Not completely. While calories themselves don't make a food healthy or unhealthy, healthy foods definitely skew towards low caloric density, and unhealthy foods definitely skew towards high caloric density.
No causation, very strong correlation.