That’s really interesting actually. Has anyone tried training a LLM on e.g. whale speak? I wonder if we could end up translating it by interacting with the whale model, that would be very cool.
Disclaimer: I have not read the paper, so I can't judge about its contents.