Recently I started digging into text-to-speech implementations of which Google seems to have the best know-how.
https://google.github.io/tacotron/publications/global_style_...
Those samples sound already frighteningly human.
Not to disparage the DeepVoice3 in anyway! There must have been a lot of work put into it.