I think there is more to it than just batch speed. For real-time processing you can’t look ahead Beyond the current buffer. Basically the question is can the model be run in a streaming fashion, and is it still fast running that way

Real time means it doesn't need the whole audio clip to work..