I wonder if the audio stuff works like ViTS. Do they just encode the audio as tokens and input the whole thing? Wouldn't that make the context size a lot smaller?
One does notice that context size is noticeably absent from the announcement ...
One does notice that context size is noticeably absent from the announcement ...
No comments yet.