This is something I am very interested in, There’s lot of work to be done when it comes to building verified and explainable learning systems (not just neural networks).
I think the verification tools are finally getting better to the point of them being useful for this kind of stuff. L