Humans are also "black boxes" we don't fully understand. It's worked pretty well.
It's a straw man.
The need for transparency in process is known, documented, and undisputed. Your comment has no relevance. My brain might be a black box, but I can still communicate and/or document the specifics of a process.
Can [insert your preferred model] do that? Didn't think so.