If it's a serious key like AWS or Zendesk then you're probably screwed the instant it gets stolen.