The problem with deep fakes is a hostile nation taking over your phone/facetime calls and sounding exactly like your own parents. How can you tell if they can do it in real time? A bad actor could get you to do some really bad things.
If you're thinking such an evil persons should be in jail, don't worry, they are! It's them who are in South American prisons using burners or stolen phones.
https://www.lavoz.com.ar/sucesos/estafaban-desde-prision-con...
Edit: that was from Argentina, another one in Chile:
https://www.heraldo.es/noticias/aragon/zaragoza/2015/04/09/l...
That can be very useful when it is useful to only have establish trust once but that's not really the problem described here. The secret word is probably more useful in being so simple, however it still has to be established beforehand.