The Raspberry Pi only has 12 bits of audio output resolution and - at least historically - has had problems with latency-related audio glitches due to Pi-specific drivers spending too much time with interrupts disabled.
Lots of lag may cause problems:-\