Video from a pair of eyes is many terabytes per year though. If you compress it with best codecs. Raw video would be closer to 1PB per year.
I think people overestimate the data efficiency of the biological neural networks w.r.t. transformer models.
I think people overestimate the data efficiency of the biological neural networks w.r.t. transformer models.