There is a considerable ongoing research effort in formal verification of learned systems. Once an ML system has been trained, it becomes deterministic and can be tested.