We can always work backwards, regardless of AI.
OC was saying (I’m going to paraphrase) that this is the death of understanding in meteorology, but it’s not because we can always work backwards from accurate predictions.
I guess there could be some value in analyzing what inputs have the most and least influence on the AI predictions.