Carrying a debit card (at least by the american definition of "debit card", other countries may have more sane CC security) is a risk in itself -- if you lose the card (or just the number), then your bank account can be wiped out before you can stop it, then you'll start bouncing checks.

And since you have a card for each account, they can wipe out your savings too, making it harder to replenish your checking account.

You'll most likley get the money back, eventually.

I carry only an ATM card (PIN required), no debit card that debits directly from my bank account.

(note that this isn't just a hypothetical vulnerability, my company had to give a paycheck advance to an intern who lost her debit card in a bar, had her account wiped out and couldn't get money back from her bank in time to make rent)