Much of the remaining latency is likely coming from FEC and interleaving needed for the RF links.

http://en.wikipedia.org/wiki/Forward_error_correction#Interl...