Interesting, we're using a completely different module (Xavier NX). And the same, disgustingly hacky, fix, of forcing a reset until it works.
echo 1 > /sys/bus/pci/rescan
sleep 1
Sometimes it brings the PCI card back, so I just run this as part of my boot sequence.