> they do model what appears to be the core function of integrating the synaptic inputs and firing in non-linear fashion when this integrated input crosses some threshold
> what appears to be
> Nobody knows how much would be gained by using a more biologically accurate model of a neuron.
Philosophical:
The neuron is an integral part of it's environment... so using models of much more primitive biological neurons ( less "processing" distance between env and self ) might yield something, I believe, but not evolved ones, where they are part of tens of thousands of systems in systems with only a few of them layered like onions. It's a completely different definition of distance and the neural nets are not part of anything.
> Much of the low level detail may be irrelevant, but the timing aspect of it
Tens of thousands of asynchronous contiguous and non-linear events firing at just the right timing in 10s of thousands different places at timings that create something even crazier than perfect synchrony ... That lower level detail is likely responsible for the timing ... it's a bit like why osmotic pressure inside and outside is important and implicit to all the ratios relevant in the different spots of the body/organ/tissue ....
I'm unimpressed by AI and genAI to this day. But I think it's cool. ... it can all be achieved without calling it "AI" at all. Just a bunch of nodes and well sorted and tagged input ... it's social proof laundered awe mostly ... no chance against that marketing machine, so LLM = AI. Every time you "think" it can be more than a dictionary and wikipedia I realize how stupid I am for thinking that briefly when I read the reply to my prompt. Same goes for code. It's holy shit, wow, ah wait, there's that open source code and that free frontend design bit and all the other things, snippets, assets I had already bookmarked somewhere or sometime in the past ...