Hacker News Reader

A parameter in a neural network is more comparable to a synapse of which the brain has 100 trillion. And yes, we will get there too one day.

View on HN

That's a good point, but amount of training data these neural networks take doesn't seem compatible to me.

If I read all day everyday from the moment I was born until now, I couldn't have read 45 terabytes of text.

Don't forget the training that you did before you were born through evolution. It wasn't text but was a bunch of transferrable skills that help us understand text.

Yes, but what we understand about how the process of natural selection shaped the human brain looks even less like a neural network than what we understand about brains.

I guess if we want to reduce the comparison to something vague like "the human brain and neural networks both developed over many iterations," I could agree with that, but that doesn't seem very interesting.

If the two were actually comparable, it would look more like: 1. Use NN (or GP) to develop set of hyper parameters 2. Give said HP to neural nets that, thanks to the HP, can be trained on a very limited said of data.

I am not aware of any successes with methods like these.

Reply on news.ycombinator.com