Jitter does not matter if deadlines are met. It only matters if it can cause deadlines to be missed (sometimes).
But very little digital audio gear works that way these days. The buffer sizes may be small (e.g 8 or 16 samples), but most hardware uses block structured (buffer by buffer) processing.
So there's always a delay, even if 1 sample.