Is AI Smarter Than an 8th Grader?

Even poems are "easy". They're typically very short, there's a million ways to write one, so if you roll the LLM dice enough times you'll probably find something that's plausibly interesting.

What I've yet to see is an LLM that can write anything remotely like a competent short story that doesn't just read like a plot summary. I feel like that's a fair, reasonable test of pseudo-creative output.