If the thief can get you to hand over your phone, I'm not sure what's stopping him from asking for your passcode.