We are predisposed by our Victorian ancestors to assume that anything which gives us great pleasure must also be bad for us. Hence fat is believed to be worse than carbs.