1,299 karma · joined August 7, 2018
https://rpandey.tech
Companies don't want to take on the burden of training junior devs and then complain when there aren't enough senior devs to go around. Obviously it makes sense from a business perspective, but taking a step back, training junior talent in this field should be a top priority for everyone.
What advantages would this bring for a user like me? I guess it might make more sense for people working closer to production?
Hyperbolic space, on the other hand, enables you to embed hierarchical information in a single dimension due to the curvature itself (yes this is hand-wavey mainly because I still barely understand it, read the paper). This is very conducive to embedding graphs, and especially structured graphs (or trees).
We were on the beach sitting on blankets, and my phone somehow got lost in the folds of the blanket while I was coming up. For the next ~4 hours I basically forgot "who" I was, being deprived of a phone that constantly shows me my friends, notes, and pictures. Eventually, I did find my phone and it was the weirdest experience ever to look at my phone and slowly start "remembering" who I am.
Not sure if it's just me, but this is getting very hard to separate during quarantine. I often remember conversations that happened over text as having happened in person. Perhaps my mind is accounting for the lack of face-to-face interaction.
That 5000 number is interesting though. Do they feel a connection with the Elamites, Sumerians, and Akkadians? That would be kind of surprising. It would make sense for them to connect with Xerxes and the Achaemenids or Medians though, despite the difference in religion. Sorta related, I've heard that there's a growing Zoroastrian movement among the "rebellious" Persian youth.
2000 / 25 = ~80 generations
It's not some uncountable number with a million zeros. Assuming everyone knew one of their grandparents, it's more like 40 interpersonal "links".
I honestly feel like if Europe didn't have the Early Middle Ages (~500-1000AD), we would feel pretty connected to all the history that happened before in the same way that we feel pretty connected to Copernicus developing Heliocentrism or Columbus arriving in the New World.
I wonder whether civilizations with seemingly more continuous histories like China feel more connection to the rest of their history. India's history was sort of interrupted by Islamic invasions starting from the 1200s. The Middle East, despite its tremendously long history, experienced a significant shift in culture with the rise of Christianity and then Islam.
If Chinese people don't feel that historical connection, on the other hand, it might mean that our disconnect with ancient history might more just be a product of Modernity and the rapid change of the last couple centuries.
Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures [2] applies DFA, an approach to training neural nets without backprop, to modern architectures like the Transformer. It does surprisingly well and is a step in the right direction for biologically plausible neural nets as well as potentially significant efficiency gains.
Hopfield Networks is All You Need [3] analyzes the Transformer architecture as the classical Hopfield Network. This one got a lot of buzz on HN so I won't talk about it too much, but it's part of a slew of other analyses of the Transformer that basically show how generalizable the attention mechanism is. It also sorta confirms many researchers' inkling that Transformers are likely just memorizing patterns in their training corpus.
Edit: Adding a few interesting older NLP papers that I came across this year.
StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding [4]
Do Syntax Trees Help Pre-trained Transformers Extract Information? [5]
Learning to Compose Neural Networks for Question Answering [6]
Parsing with Compositional Vector Grammars [7]
[1] https://arxiv.org/abs/2006.11287
[2] https://arxiv.org/abs/2006.12878
[3] https://arxiv.org/abs/2008.02217
[4] https://arxiv.org/abs/1908.04577
[5] https://arxiv.org/abs/2008.09084
Remote: Open to it
Willing to relocate: Open to it
Technologies: PyTorch, TensorFlow, Keras, Sci-kit Learn, NumPy, Pandas, Flask, Express, React, React Native, PostgreSQL, SQLite, Python, JavaScript
Résumé/CV: http://resume.rpandey.tech
Email: rohan [dot] pandey [at] gmail [dot] com
Website: https://rpandey.tech
GitHub: http://github.rpandey.tech
LinkedIn: http://linkedin.rpandey.tech
I've won 10 hackathons with my Fullstack expertise, am publishing an undergrad Machine Learning research paper, and am using DL for NLP + Computational Neuroscience work in my current internship. My areas of interest include Deep Learning, Natural Language Processing, Neurotechnology, and Bioinformatics but I also just love building impactful products!
Open to internships, part-time, and some full-time positions.
> During or just prior to this "cat gap," numerous caniform species evolve catlike features indicative of hypercarnivory, such as reduced snouts, somewhat enlarged canines, and fairly extreme reduction of their crushing molars.
They propose that Felids were pushed out of their hypercarnivorous niche by Canids as evidenced by changes in Canid dental morphology from this period.
Remote: Open to it
Willing to relocate: Open to it
Technologies: Flask, Express, React, React Native, PostgreSQL, SQLite, PyTorch, TensorFlow, Keras, Sci-kit Learn, NumPy, Pandas, Python, JavaScript
Résumé/CV: http://resume.rpandey.tech
Email: rohan [dot] pandey [at] gmail [dot] com
Website: https://rpandey.tech
GitHub: http://github.rpandey.tech
LinkedIn: http://linkedin.rpandey.tech
I've won 10 hackathons with my Fullstack expertise, am publishing an undergrad ML research paper, and am currently working on DL for NLP in my internships. My areas of research interest include Deep Learning, Natural Language Processing, Neurotechnology, and Bioinformatics but I also just love building impactful products! Open to internships, part-time, and some full-time positions.
This isn't what social cooling results in though. Thoughts and opinions are imposed, it's just that their imposition is monopolized and becomes implicit. Dirty laundry will still be aired in the town square, but it'll be the King's and everyone will be forced to smell it.
Remote: Open to it
Willing to relocate: Open to it
Technologies: Flask, Express, React, React Native, PostgreSQL, SQLite, PyTorch, TensorFlow, Keras, Sci-kit Learn, NumPy, Pandas, Python, JavaScript
Résumé/CV: http://resume.rpandey.tech
Email: rohan [dot] pandey [at] gmail [dot] com
Website: https://rpandey.tech
GitHub: http://github.rpandey.tech
LinkedIn: http://linkedin.rpandey.tech
I've won 10 hackathons with my Fullstack expertise, am publishing an undergrad ML research paper, and am currently working on DL for NLP in my internships. My areas of research interest include Deep Learning, Natural Language Processing, Neurotechnology, and Bioinformatics but I also just love building impactful products! Open to internships, part-time, and some full-time positions.
Remote: Open to it
Willing to relocate: Open to it
Technologies: Flask, Express, React, React Native, PostgreSQL, SQLite, PyTorch, TensorFlow, Keras, Sci-kit Learn, NumPy, Pandas, Python, JavaScript
Résumé/CV: http://resume.rpandey.tech
Email: rohan [dot] pandey [at] gmail [dot] com
Website: https://rpandey.tech
GitHub: http://github.rpandey.tech
LinkedIn: http://linkedin.rpandey.tech
I've won 10 hackathons with my Fullstack expertise, am publishing an undergrad ML research paper, and am currently working on DL for NLP in my internships. My areas of research interest include Deep Learning, Natural Language Processing, Neurotechnology, and Bioinformatics but I also just love building impactful products! Open to internships, part-time, and some full-time positions.
I think what OP might've been alluding to is the idea that phenomena like dark energy could have a more elegant explanation that is the result of emergent behavior at large scales. Just like magnetism was originally seen almost like magic, but it was later realized that it's simply an emergent property of the electric force i.e. electromagnetism.
[1] https://www.cell.com/current-biology/pdfExtended/S0960-9822(...