See the Google blog post from last summer, https://research.googleblog.com/2017/08/transformer-novel-ne... A novel simplified architecture for sequences and translation.