Are you using polyphase channelizer now, as opposed to individual XFIR tuners? If so, does that still provide better performance given sparsely occupied channels?
I did switch to FFT based filters and that helped a lot. CPU requirements are a lot less. Using RTLs with 2M sample size, instead of SDR more bandwidth also helps. It is a poor mans version of HW-based channelization.