782 karma · joined May 6, 2013
Sincerely,
The Pentagon
Nonsense, there are countless ethical and alignment harms in the wild, and have been for many years. For example:
- midjourney ripping off artists = ethical harm
- google search telling people to throw batteries in the ocean = alignment harm
- Buzzfeed slashing staff and replacing them with chatgpt = ethical harm
- google photos labelling african americans as "gorilla" = alignment harm
- deep fakes = ethical harm
- COMPAS parole recommender biased against minorities = alignment and ethical harm
- Amazon resume screening model biased against women and minorities = alignment and ethical harm
...I could do this all day, but the point I'm trying to make is that AI ethics and AI alignment are both valid and important concerns. Hoping that companies will take care of them without regulation is folly.
I'm a huge fan of Jupyter, I use Jupyter Lab as my primary IDE, but a little confused here. Maybe if I frequently connect to different servers? The python env discovery looks cool, but nb_conda_kernels does this for me now.
He takes this shot in passing and it is a great summary of how much he misunderstands AI safety. For many current researchers, alignment is a mathematical problem, not a philosophical one.
The whole screed is against a set of strawman "pseudo-traits" that are not required for the alignment problem to be an existential problem. To be clearer: the "boring" engineering problems he admits to in the beginning have the potential to become exponentially more difficult as machine learning deployments become more powerful, to the point of becoming a human threat. No STIILTB required.
https://blog.janestreet.com/l2-regularization-and-batch-norm...
Amazing result, well done & thank you for sharing!