Most is owed to Social Security. The money paid into that is invested in US Bonds. That is based upon an article I say a while ago.
As for taxes, the past few GOP admins lowed taxes for the ultra wealthy and corporations. If they had stayed at the same level, the debt would be much lower. Plus Bush's invasion of Iraq, for no reason, added quite a bit also.