I was just playing a board game with a friend, and we spent a while looking through the (fairly complicated) rules. At some point, I had the bright idea to feed the manual to Claude, so we could ask questions about it.

It all went great, Claude even gave references, until it hallucinated an innocuous but significantly game-breaking rule ("rest lets you heal one health for two stamina").

This just reinforced my lack of trust in LLMs, and I would sure as hell not ask an LLM what drugs were safe or not.