It would be trivial for someone to record you saying it without your knowledge, to unlock your phone at a later date.