812 karma · joined February 4, 2020
Sometimes I wonder if I'm the only person that's read a given article... Though I guess I actually read it last time it was posted.
But isn't this exactly what the article is arguing?
> As trees grew in the cleared lands near roadsides, kudzu rose with them. It appeared not to stop because there were no grazers to eat it back. But, in fact, it rarely penetrates deeply into a forest; it climbs well only in sunny areas on the forest edge and suffers in shade.
> Still, along Southern roads, the blankets of untouched kudzu create famous spectacles.
> I think that Python is what you get when you have real programmers (^TM) try to create the programming equivalent of something like MATLAB, Mathematica, and R.
I think this is a better description of Julia tbh, at least relative to MATLAB.
Numenta has attempted to implement a system to this effect (see the wiki page https://en.wikipedia.org/wiki/Hierarchical_temporal_memory) for quite some time with not particularly much success.
Personally I think the kinds of minds we create in silico will end up being very different, because the advantages and disadvantages of the medium are just very different; for example, having a much stronger central processor and much weaker distributed memory, along with specialized precise circuits in addition to probabilistic ones.
Transformers, while not exactly functions, don't have a feedback mechanism similar to e.g. the cortical algorithm or any other neuronal structure I'm aware of. In general, the ML field is less concerned with replicating neural mechanisms than following the objective gradient.