My dad passed away a few months ago. Going through his things, I found all of his old papers and writings; they have great meaning to me. It would be so cool to have them as audio files, my dad as the narrator. And for shits, try it with a British accent.
This may not abate the concerns, but I'm sure good things will come too.
Maybe a decade ago, I came across a cassette tape that he had used to record himself reading from a book for school - several minutes in duration.
It was incredibly surprising to me how much he sounded like my older brother. It was a very emotional experience, but personally, I can't imagine using that recording to bootstrap a model whereby I could produce more of his "voice".
And possibly another one, but that would be a spoiler
It is healthier for us to just let others do as they wish with their time without passing judgement.