The answer is of course pki with trust rooted in the device. If it isnt your grandson's iphone attesting itself your iphone shouldn't believe it is your grandson.
Your answer already exists in almost every "E2EE" app. How many times does a person even access their convo partner's Safety Number/Security Code let alone verify it out of band?