Or they can "One Plus One" you where they ask you verification questions from your credit profile to verify you are who you say you are.
I edited to include the process as written by the TSA on their website. It's definitely going to be less fun if you don't bring ID, and they suggest you arrive early.
It's certainly annoying but it's not all that big of a deal. Tens of thousands of people lose IDs and wallets every year and manage to get on the plane home anyways. I've seen people go through it they use common sense means to verify you.