In magnetic confinement reactors, the runaway neutrons collide with the reactor's shielding and can make it radioactive by neutron activation. I don't know if it's the same for inertial confinement, but I suppose it could be an explanation.