Previous discussion on “Attention is all you need”: https://news.ycombinator.com/item?id=15938082
Recent work by Jakob and team:https://ai.google/research/people/author37567/
Image transformer is particularly interesting
Recent work by Jakob and team:https://ai.google/research/people/author37567/
Image transformer is particularly interesting