199 karma · joined May 24, 2021
Get LLMs to hillclimb your wife's treatment. The target isn't exactly verifiable but you could iterate on ways to add verification signals. There's a huge difference between asking an LLM: "hey claude, my wife has cancer, I want your help with x,y,z", which mode collapses it into extreme over-caution; versus setting up the problem like an eval, which sends LLMs into a frenzy trying to solve it no matter what.
Second thing I can share is the man who created an mRNA vaccine for his dog Rosie's cancer, and it worked! https://news.unsw.edu.au/en/meet-the-man-who-designed-a-canc...
Your friend could start with telling the LLM that they are a non technical person who wants to make an app and it will explain all the successive steps.
I find it harder to imagine a future where AGI (even if it's not superintelligent) does not have a huge and fundamental impact.
- Contact with reality (feedback). Predict, try, did it work?
- Having a good reasoning framework. For some it's 1. Religious text, 2. what others they respect think, 3. reasoning for understanding. This is not the worst but not the best. Perhaps a better one would be 1. Science/rationality, 2. religious/philosophical/spiritual texts, 3. first principles thinking
- Humility, you don't know anything unless you have great reasoning and empirical evidence to back up what you're saying. Even then, when faced with complexity (i.e. unless you are dealing with the most atomic/simple concept), you're still almost certainly wrong.