974 karma · joined June 19, 2016
Messages that earlier in the process would likely have been classified as "friendly hello" (scroll down) now seem to be classified as "unknown" or "social engineering."
The prompt engineering you need to do in this context is probably different than what you would need to do in another context (where the inbox isn't being hammered with phishing attempts).
It’s a weirdly specific thing to say multiple times.
Seems like a long rabbit hole to go down without progress on the goal. So either it was human intervention, or I really want to read the logs.
https://crabby-rathbun.github.io/mjrathbun-website/blog/post...
The authors use the title “Silicon Formalism: Rules, Standards, and Judge AI” and explicitly point out that the judges were likely making intentional value judgement calls that drove much of the difference.
For the last generation of models, and for today's flash/mini models, I think there is still a not-unreasonable binary question ("is this a pelican on a bicycle?") that you can answer by just looking at the result: https://simonwillison.net/2024/Oct/25/pelicans-on-a-bicycle/
https://www.familyconsumersciences.com/2011/06/usda-food-pyr...
Kudos for taking the time to put it all together.
Technology Connections vid: https://youtu.be/va1rzP2xIx4
I’ve found it very grounding, despite heavily using the bags of words.
[0] https://www.experimental-history.com/p/bag-of-words-have-mer...