Prompts missing is a severe minus in terms of reproducibility - and hence how serious I take the paper. I would urgently recommend to the authors to add everything needed to reproduce the results, ideally as a well-coded GitHub repo.
Colab links:
- GPT-4 Example: https://colab.research.google.com/drive/1Bk9uBCBvzuX00Rex-t1...
- GPT-4 Small Eval: https://colab.research.google.com/drive/1_-uHvW2oLtcCXz0c-G_...
- Claude 3 Opus Example: https://colab.research.google.com/drive/105jUAGanp7ZLG-Q9Hei...
- Claude 3 Opus Small Eval: https://colab.research.google.com/drive/1-IH68TUuqf_CZyptSSr...