Until you lose your device or it breaks suddenly.
I feel this tradeoff is worth it to me; certainly it is no worse than email or SMS as the second factor.
The biggest advantage for me is using the hardware secure enclave, thus effectively getting a 2nd factor.