Transformers as Multi-Task Learners: Decoupling Features in Hidden Markov Models

interesting paper. essentially a peek under the hood of why transformers generalize so well across multiple tasks, through the lens of hidden markov models.