Yeah that's what leads to situations like the Greek debt crisis [1].
You can't just rack up debt forever, and just assume that we'll pay it back later WITH INTEREST. You also can't just "cancel" debt; the bill eventually comes due.
[1] https://en.wikipedia.org/wiki/Greek_government-debt_crisis