> But it brings up questions for the future - what happens when AI is wrong but used as proof of something?
You bring up a fair point, but I don't think AI is special in this regard. Imperfect sources of information synthesis (humans, naive algorithms, etc) are used all the time. Hopefully, AI should simply add one more data point from which to understand a given situation.