1,299 karma · joined August 7, 2018
https://rpandey.tech
I had much the similar feeling during my first LSD trip, but haven't met too many others who shared this same idea. Life is the means by which the Universe organizes and becomes aware of itself. It's our Darwninistic telos to get off of this rock and colonize the stars.
https://akariasai.github.io/files/llm_memorization.pdf
This is essentially what I'm building for the content marketing vertical.
Does this mean that minds don't ever naturally build symbolic models of the world, or rather just that they try to minimize the computationally intensive (and now NP-hard) task of uncovering a symbolic model? I'd definitely lean toward the latter (ironically due to my intuition).
It also aligns quite well with Kahneman's System 1 - System 2 distinction, where the symbolic System 2 is reserved for situations that most strongly require such computation.
Location: Silicon Valley / San Francisco Bay Area (CA), Pittsburgh (PA)
Remote: Open to it
Willing to relocate: Open to it
Technologies: Python, PyTorch, TensorFlow, Keras, HuggingFace, SpaCy, NLTK, NumPy, Pandas, Sci-kit Learn, Flask, JavaScript, Express, React, React Native, PostgreSQL, SQLite
Résumé/CV: https://rpandey.tech
Email: '%s.%s@%s.com' % ('rohan', 'pandey', 'gmail')
I'm a research consultant studying at Carnegie Mellon who's won over 10 hackathons with my full-stack experience and published machine learning research papers at top venues like NeurIPS and EMNLP.My areas of interest include Deep Learning, Natural Language Processing, Neurotechnology, and Genomics, but I also just love doing AI/ML research in a customer-oriented startup context.
Open mainly to consulting positions and potentially new grad roles starting mid-2023.
https://math.stackexchange.com/questions/448527/are-the-g%C3...
People have thought Deep RL would lead to AGI since practically the beginning of the deep learning revolution, and likely significantly before. It's the most intuitive approach by a longshot (even depicted in movies as agents receiving positive/negative reinforcement from their environment), but that doesn't mean it's the best. RL still faces huge struggles with compute efficiency and it isn't immediately clear that current RL algorithms will neatly scale with data & parameter count.
The most powerful narratives are the biggest narratives.
Most big narratives are non-verifiable or non-empirical narratives, e.g. "the creator of the universe died for your sins out of love for you".
Find the biggest narrative that satisfies your epistemological standards and you will also find the most meaning for yourself.
Your narrative need not change how you live your life, it simply provides context—a bigger picture for every action you take.
For me, this is darwinism.
Not much of a site to see, but I like to think it gets the point across in a pretty clean 1 page manner. Just a single HTML file.
Please reach out if interested!
Location: Silicon Valley / San Francisco Bay Area (CA), Pittsburgh (PA)
Remote: Open to it
Willing to relocate: Open to it
Technologies: Python, PyTorch, TensorFlow, Keras, HuggingFace, SpaCy, NLTK, NumPy, Pandas, Sci-kit Learn, Flask, JavaScript, Express, React, React Native, PostgreSQL, SQLite
Résumé/CV: https://rpandey.tech
Email: '%s.%s@%s.com' % ('rohan', 'pandey', 'gmail')
I'm a research consultant studying at Carnegie Mellon who's won over 10 hackathons with my full-stack experience and published machine learning research papers at top venues like NeurIPS and EMNLP.My areas of interest include Deep Learning, Natural Language Processing, Neurotechnology, and Genomics, but I also just love doing AI/ML research in a customer-oriented startup context.
Open mainly to consulting positions.
Oogway represents Daoism with its search for inner peace and going with the flow/dao. Shifu, on the other hand, represents Confucianism with its concerns for moral duty and worldly social harmony. The internal and external, immaterial and material—each has a role in the construction of a philosophy conducive to success.
"Oogway explains that he can not make the peach tree blossom or bear fruit before it is ready. Shifu retorts that there are things that can be controlled like when the fruit falls or where the seeds are planted. Oogway finalizes by saying that no matter what is done, the tree will still grow to be a peach tree, instead of any other kind of tree and that great things can happen if it is helped and nurtured. Oogway argues the point of Daoism and that nature will take its course. Shifu argues the point of Confucianism and that everything has order." [1]
Also shameless plug for my essay about Culture, Philosophy, and Reinforcement Learning which comments on similar dualities and their relations. [2]
[1] https://medium.com/@gvreligion/quit-dont-quit-noodles-don-t-...
[2] https://medium.com/@rohan.pandey/culture-philosophy-and-rein...
Memorization implicitly requires learning and characterizing them entirely separately as modern education does is pretty faulty.
Location: Silicon Valley / San Francisco Bay Area (CA), Pittsburgh (PA)
Remote: Open to it
Willing to relocate: Open to it
Technologies: Python, PyTorch, TensorFlow, Keras, HuggingFace, SpaCy, NLTK, NumPy, Pandas, Sci-kit Learn, Flask, JavaScript, Express, React, React Native, PostgreSQL, SQLite
Résumé/CV: https://resume.rpandey.tech
Email: '%s.%s@%s.com' % ('rohan', 'pandey', 'gmail')
I'm an undergrad at Carnegie Mellon who's won over 10 hackathons with my full-stack experience and published machine learning research papers at top venues like NeurIPS and EMNLP.My areas of interest include Deep Learning, Natural Language Processing, Neurotechnology, and Genomics but I also enjoy building impactful products!
Open to internships, part-time, and some full-time positions.
I wonder whether the fundamental structure of curricula could be changed to take advantage of this fact, because I think it's true for a lot of people.
Isn't this true of humans too when we rely on entire supply chains for our food, water, and electricity?
https://img.etimg.com/photo/msid-65207066,quality-100/graph....
With a pretty standard 4x multiple, it's a $10k business. Though I imagine the slower growth etc resulted in an actual valuation ~$8k.
Humans use language with purpose, to complete tasks and communicate with others, but GPT-3 has no more goals or desires than an n-gram model from the 90s. LMs are essentially a faculty for syntactically well-formed or intuitive/system 1 language generation, but they don't seem to be much more.