Example: 30 billion, at say, 2% interest per year (which a government could easily get, and the US can currently do much better then) is only 600 million interest repayments. And remember, this is before accounting for inflation, since the loan can be repaid with much cheaper dollars in the future (i.e. inflation usually sits at around 2%, and a government can tweak that as needed).
US debt servicing currently compromises about 7% of the annual budget. So there's no imminent risk that interest payments couldn't be paid for out of general revenue.
Even if the US really needed 600 million per year of some service, it would _still_ make more sense to take out the 30 billion loan, plough 28.8 billion into infrastructure or other investments, then spend 600 million on those services, 600 million on financing the interest, and repay the entire thing with simultaneously cheaper dollars in the future _and_ the new revenue they've generated from growth.
The only _real_ danger, is the risk you may have to run a larger fraction of your annual revenue into debt servicing if you can't refinance. But you can put money aside to account offset that contingency, and still borrow.
My mental model is that if inflation is 2%, the nominal interest rates are 2% higher than the real interest rate. How much does inflation affect the real interest rate?
The average interest rate over the past 50 years has been something like 5% [citation needed on my own number]. If we hit that, we will very quickly need to pay more money, and a lot of that old debt rolls over each year.
The US does not have a debt problem in 2013; as has been said, we can borrow at effectively zero. The US might very well have a big debt problem in 2018 or 2023.
Also, inflation concerns (by reasonable people) only occur when the economy overheating. An overheating economy automatically reduces the government deficit via increased tax flows and reduced social security spending.