How to build a brain – An introduction to neurophysiology for engineers
juliuskunze.com
juliuskunze.com
https://media.ccc.de/v/31c3_-_6573_-_en_-_saal_2_-_201412281... https://media.ccc.de/v/32c3-7483-computational_meta-psycholo... https://media.ccc.de/v/33c3-8369-machine_dreams
31c3, 32c3 and 33c3 are the yearly german hacker group ccc conferences at the end of december.
2017 was 34c3 and held in leipzig. (google img search to get a feel what i'm talking about https://www.google.de/search?q=34c3&source=lnms&tbm=isch)
All talks are free to watch (there are a lot more on media.ccc.de).
If you are interested in seeing how the postsynaptic neuron manages its synaptic receptor numbers (and the intricate process the backprop algo is cheating), you might like to check out a 3D simulation I've made to model this process.
Animation: https://www.youtube.com/embed/6ZNnBGgea0Y Code on github: https://github.com/subroutines/plasticity
(note the animation is not too exciting, so you might want to skip forward a few times)
But basically you will see that neurons rely on stochastic surface diffusion of receptors to deliver new receptors to synapses. The takeaway is that during rest (or whatever you want to call it... baseline, non-learning, etc) synapses will reach some steady-state number of receptors. If the synapse undergoes some learning event, it needs to 'capture' more receptors to increase the steady-state amount. It does this by modifications to proteins just below the surface of the postsynaptic membrane that act as velcro to surface receptors floating by. Thus synapses take control of their synaptic weights by managing the surface diffusion rate of excitatory receptors.
But I agree there is much we neuroscientists can learn from the machine learning research that provide insight into the biological system. Trust me- we are paying close attention.
Can you give me rough time scale for how quick neurons learn (synaptic plasticity)? I have a recollection that the time scale is in order of tens of milliseconds but I might be wrong.
To specifically address your question about how quickly learning happens in neurons... it's fast. Is it ~10ms? mmm, that seems incredibly fast, and I'm not sure I can provide any definitive answer. I think it heavily depends on what you're willing to interpret as 'learning' when examining events on the molecular level. There are events that engender near-immediate alterations to ongoing transmission; and other events that support lasting electrical changes (necessarily?) develop across longer timescales. You might think of this distinction as the difference between being able to hold a phone number in consciousness via repeating it over and over, and then actually being able to recall that phone number 5 minutes later. In the former certainly something internally must have changed because a moment ago you weren't repeating this number in your head, and now you are. On the other hand, can we really say it was learning if the number is immediately lost the moment it leaves consciousness. Anyway, I"m not going to wax philosophical on that. I'll just show you some data for timescales we think are sufficient to produce lasting increases in synaptic efficacies...
Here is a video showing a single spine just after 2-photon 'glutamate uncaging':
(as I mentioned above, glutamate receptors are the primary receptors involved in fast-excitatory transmission; so uncaging tons of glutamate right next to a spine is going to evoke immediate plasticity changes - particularly under these experimental conditions)
Note that in just a few seconds the spine has doubled in size. Morphological change in the spine are probably not the first events that alter synaptic transmission, but morphological changes to the spine are a reliable sign of a lasting memory trace.
Here is a whole cell recording of the electrical response in a neuron to incoming signals, before and after stimulation like that above ('EPSC' stands for 'excitatory post synaptic currents'):
Fast high-bandwidth interconnects use this, too, in optical fibre modulation for telecom, and not just plain Amplitude Modulation either. I guess the interconnect between the processing nodes of a supercomputer are connected in a similar manner.
I would really like to know how brain waves figure into this, does the brain do "wifi" between distant nodes?
> How do brains information?
You accidentally a word! Not just there, by the way.
By using just the model of neural processing one can achieve amazing results. Whether a neuron activates its output links, depends on the weight sum of the activated input links. If the sum is strong positive the Neuron activates its output, if it's strong negative the neuron even inhibits activation of successor neurons. But, even that basic tidbit is missing in the text.
"The neuron adds inputs in some way..." Really? Oh man. I consider myself an engineer, but that article doesn't say anything about how neurons and neural nets specifically work.
The main problem seems to be that we actually don't understand all the building blocks, at least according to the article:
> There are fundamental questions left unanswered: What information do neurons represent? How do neurons connect to achieve that? How are these representations learned?
Until we figure out how and why connections are created between neurons, we only know how the brain responds to stimuli it has already learned, but not how it learns new information.
There's a series of articles by a guy who fixes bugs in an old game without source code, in plain assembly. (Unfortunately, it's in russian only.) https://habrahabr.ru/post/349296/
Think guitar string: what matters to tune it is the tension more than composition. In the same way, standing waves in brain tissue reflect geometry and connectivity as much as membrane potentials.
Calling the answers "partial" is fair, but I feel like the author understates the number of observations backing typical neural models? The lab I belong to created Spaun, which admittedly uses a pretty simple neuron model, but still matched a ton of neural and behavioural data! There's also Leabra, which I have some qualms with, but still has a pretty large collection of results.
But clockless processors exist, although they are not particularly popular.
Any neuroscientists out there know if cycles (from graph theory) are possible in the brain?
Put another way, would the signal generated from neuron1 be able to travel around in a circuit of other neurons and come back to activate neuron1 again? Or is this not possible because neuron1 would still be recovering?
I've wondered this for awhile would love it if someone had the answer :)