Time to re-designed our artificial neural networks
Not sure our ANNs will ever be able to model them all.
The Big question is: WHERE is the Complexity? If Complexity is Fixed in a System, it must be Somewhere. (you can see this at play any time you look at a large software system.) Do you have simple 'blocks' and many of them? OR, do you have more complicated blocks (requiring more computons), but fewer of them? I think this is an exciting research area right now.
We have no idea how much of this complexity is fundamental and how much is incidental, of course. But it is certain that every part of the brain is way more complex than the ultra-simplistic ANNs, and replacing the sigmoid function with some ODE will not move that needle significantly.