It's food and food should never be a luxury. Historically it has often been a luxury unfortunately.
I empathize with the position that any tax on a food item will disproportionally impact the poor. And I agree, everyone should have a baseline level of housing and food accessible to them regardless of their circumstances. But if a food item has huge negative externalities, surely we should do something to limit its appeal and consumption, right?