204 karma · joined January 8, 2023
https://papers.nips.cc/paper/2012/hash/c399862d3b9d6b76c8436... https://papers.nips.cc/paper_files/paper/2012/file/c399862d3...
https://arxiv.org/pdf/1512.03385
https://arxiv.org/pdf/1511.07122
https://arxiv.org/pdf/1603.05027
https://arxiv.org/pdf/1409.2329
https://arxiv.org/pdf/1512.02595
https://arxiv.org/pdf/1409.0473
https://arxiv.org/pdf/1506.03134
https://arxiv.org/pdf/1706.03762
https://nlp.seas.harvard.edu/annotated-transformer/
https://arxiv.org/pdf/1410.5401
https://arxiv.org/pdf/1706.01427
https://arxiv.org/pdf/1806.01822
https://arxiv.org/pdf/1704.01212
https://arxiv.org/pdf/2001.08361
https://arxiv.org/pdf/1811.06965
https://www.cs.toronto.edu/~hinton/absps/colt93.pdf
https://arxiv.org/pdf/math/0406077
https://scottaaronson.blog/?p=762
https://arxiv.org/pdf/1405.6903
https://onlinelibrary.wiley.com/doi/10.1002/047174882X.ch14 https://github.com/Bladefidz/information-theory/blob/master/...
https://arxiv.org/pdf/1611.02731
https://www.vetta.org/documents/Machine_Super_Intelligence.p...
Moloch strikes again!
(for those who don't yet get the reference https://slatestarcodex.com/2014/07/30/meditations-on-moloch/)
but seriously, we (or they) need to define what "productivity" actually is these days and in these contexts. is it to generate revenue for a company? is it to become a self-sufficient human? is it to educate the younger generations about what's true? is it to do science? is it to increase the efficiency of whatever task you're already doing (note that increasing efficiency would result in using less compute for the same operation lol)? if we keep moving forward without sitting down and reorienting ourselves about a shared vision, given all the new things we now know since establishing our frameworks of social/economic organization, i fear that there will be a very bad outcome.
of course there are.
electronics recycling, disassembling old computers to get the raw materials into a form that can be used again. we'll need programs to automate the production and testing and analysis of the robots that will recycle the components.
another example could be someone wants to build an ecosystem monitoring station to monitor the nearby ravine (pollution levels with rainfall and other events etc.) and air quality over time. this is just a small datapoint but if people all over the place build their own ecosystem/weather monitoring things using basic electronics ordered from the internet and all plug them in to a standard observability software system then that could provide some pretty awesome outcomes including figuring the best way to clean polluted water (because some of the places will surely have implemented varying methods of sanitizing their own water).
so do we have enough engineers who care about maintaining useful tools that aren't handicapped or compromised to be able to support this endeavor? i think we do. there have to be many good eggs within these companies who die a little inside each time something like this goes through.
i still disagree with the move. but it's not as bad as it could be. maybe there's a way to "unlock" a certified device (similar to unlocking the bootloader)?
cheese