Pointing out that add more cores is yet another wall because FLOPS is only a proxy and few things are truly embarrassingly parallel when your start talking 1+ billion cores.
And yet here we are, made of neurons.
An GTX 1080 Ti has 12 billion transistors which is closer analogy to the 100 billion neurons in a human than saying we have 100 billion cores.
Furthermore, adding cores is not an exponentially-growing process. On the other hand, there is some evidence, from the fact that intelligence is possible within the human brain, that intelligence is embarrassingly parallel.
I think neurons are closer to transistor analogs than core analogs. The brain wires them up into networks that have meaning vs passing along data that has meaning. And in that context we crossed the 10 billion transistor on a chip milestone recently vs 100 billion neurons in a human brain.