Reply to Smaug123: The brain is mostly deterministic. Quantum-level nondeterminism has very low probability to matter much.
The brain is likely to be very debuggable. Even today, we continue making progress figuring out more and more things about it. If we had designed the brain, we would know its functioning almost entirely.
You know that we can understand smaller animal brain very well now, right? There are projects going on right now which aim to perfectly simulate a worm's brain. We didn't even design a worm's brain, and we would design the AI and know all its evolution principles, and have infinite access to all its internals (which we don't have with the human brain).
Reply no. 2:
Since you guys down-voted me for disagreeing with your prophet, HN rate-limited my ability to comment.