Okay but the difficulty here is getting the LLM to use the neural circuit effectively without training just wiping out the circuit. You'd need to have the circuit be a differentiable black box where gradients cannot affect the black box
Why would that be a problem? If you have a differentialable program in the circuit it should be compatible with backpropagation. It just doesn't have weights to update.