This is not open source but this was very good from their demo in terms of your own voice reproduction.

https://www.descript.com/lyrebird-ai

I hope good folks in there will help you, try reaching them.

https://m.youtube.com/watch?v=VnFC-s2nOtI