I'm not very familiar with deep learning. How does this compare to the biomimicking Spike Time Dependent Plasticity of spiking neural networks?
https://github.com/Shikhargupta/Spiking-Neural-Network#train...
https://github.com/Shikhargupta/Spiking-Neural-Network#train...
STDP falls under biophysical models of neuron simulation, where we try to faithfully reproduce biophysics of brain simulation (trivia: I started my undergrad in computational neuroscience and implemented STDP several times [1, 2, 3]). STDP is a learning mechanism, but it has not demonstrated the ability to learn as powerful models as DNN.
[1] https://github.com/ericjang/pyN
> Is there some truth to the “reverse” though —- that is, is the emerging patterns similar for similarish problems? What comes to mind is the similar first-layers in the human vision and google’s vision AI, with vertical/horizontal lines being “matched”.
I don’t know much about NNs, but in the big picture isn’t it sort of similar? Instead of discrete on-off signals where multiple firings in a short succession result in higher activation, in NNs we sort of take the integral over time of said discrete signals. Of course things like neuron fatigue are not accounted for in this model, but does the base idea differ all that much?
Or perhaps I misunderstood the whole topic and only the learning process’s difference is the question now?