>> As far as we know, neural networks indeed are at the core of human intelligence.
Right.
Quick intro to neural models, for the only very slightly mathematically inclined.
Neural networks solve this equation:
Y = W ⋅ X
Where X a matrix of inputs to a function ƒ, W a matrix of its coefficients and Y
a matrix of its outputs.
Once that's done once for all N instances of X in our dataset, a time period which we term an epoch, Y is used to calculate a measure of error, typically mean squared error:
MSE = 1/N ∑ (Y' - Y)²
Where Y' the true value of Y that we're trying to approximate. This is repeated
until the cows come home, or until the network has converged, whichever comes
home first (er, hint).
And that's neural networks in a nutshell. There's nothing much more complicated
than that (er, in theory), there's no magic and certainly nothing "like the
brain" in them at all. They're just optimisation over systems of functions. We
learned how to solve systems of functions with matrix multiplication when we
were at high school. I'm pretty sure we did - I've personally repressed the
memory but I'm pretty sure I did once have it.
Why do people insist on calling them "neural"? Who the fuck knows. Way back in
the 50s, the perceptron was based on a model of neural activation, where a
neuron "fires" when its electrical charge crosses over a threshold. This was
originally represented with a binary step function (the very one used in
Perceptron classification). That was, at the time, deemed to be "a good model"
of neural activation. A good model, my foot. Soon people moved on to sigmoid
functions which are "a better model" of neural activation. Whatever.
I've also heard it that, say, conv nets (convolutional neural networks) are
"like the brain", presumably because if you squint at the layer connection
diagrams long enough, conv nets start to look a bit like idealised models of the parts of the brain that handle vision.
But if you squint long enough, everything starts to look like everything else.
Hell, you might suggest that neural networks are based on the effin Tree of Life
from Cabala, and Geoff Hinton is Alistair Crowley reincarnated.
The whole "brain" thing is just an abstraction. You should not read too much
into it. And don't listen to the people who try to convince you neural networks
are magic- they're not. It's high school maths and a lot of very expensive
processing power.
P.S. If my notation doesn't make sense to you, you may need to use a different font in your browser; sorry about that.