Well, that's what they tell their constituents. In practice, they increase budgets, run deficits, and increase debt every year.

Federal budget figures over the last 5 presidencies (and many other similar figures) say otherwise.

They do the exact opposite when they are in power though.