As I understand it, sugar feeds the main bacterial catalyst for cavities (s. Mutans), but food stuck between the teeth provides them protection from the mechanical forces of brushing.