Is it Transformer-based? If not then it's a different beast architecturally.
Audio models tend to be based more on convolutional layers than Transformers in my experience.
Audio models tend to be based more on convolutional layers than Transformers in my experience.