HNHacker News
TopNewBestAskShowJobs

Skeptology

7 karma · joined February 7, 2025

submissionscomments
Skeptology··on Humanity's Last Exam
Some of the example prompts are unintentionally hilarious:

> Hummingbirds within Apodiformes uniquely have a bilaterally paired oval bone, a sesamoid embedded in the caudolateral portion of the expanded, cruciate aponeurosis of insertion of m. depressor caudae. How many paired tendons are supported by this sesamoid bone? Answer with a number.

LLMs are so intelligent they don't know that a "how many" question is answered with a number.

Also, something something Goodhart's law.