Ladders sound hard for neural networks. IIRC the original AlphaGo had a ladder-solver hardcoded that would determine if a ladder position is winning or losing and feed this bit into the neural network.
cf. https://gogameguru.com/i/2016/03/deepmind-mastering-go.pdf, Extended data table 2