What about transformers for robotics, like ALOHA, they seems to help with learning new tasks.