They keep cutting taxes, too. That's a big part of the problem.
A space alien newly arrived on Earth and looking at just actions taken, GAO/CBO reports, and the actual historical data, would conclude that, at least since 1980, Democrats were the ones who cared (a lot) more about the budget deficit than Republicans. The notion that voting for Republicans is the best move for a voter whose major issue is the deficit, is just marketing.