Oh please. Dumb word games isn't going to make the "is this a bird" AI approach explainable.
https://xkcd.com/1425/Even the "simple" AI's with only a few TBs of data for training still have low/no understanding what's going on to identify the features and how they relate. Sure, we can tell this neuron identifies this squiggle, but what does it mean? No fucking clue. It also shows us collectively that most of these "hard" problems we have no clue how to understand them. And although AI allows us to "do it", it's a bad hack for actually understanding, optimizing, and doing.
> That it works without you understanding it is a failure of your understanding not of the approach.
Cool. Then point me towards the tools to explain how weights in a moderate-ly sized NN are created with training data, and associated with each other and how they find the features in question.
Oh yeah. Those tools don't exist.