Yeah, getting LLMs to invent jokes is an incredibly unfair test of them - but I derive enormous entertainment from seeing them try.
Simon, perhaps you're just not funny.
Older base models produce some great stuff though, at least if you're me and think RoboRosewater and dril_gpt2 are funny.
Just like the real thing! Promising results!