Firstly, I can't refute a point that's little more than an opinion - my doubt is that a modern frontier model is significantly hallucinating within a relatively short conversation that can easily be verified. There is no way to refute or accept the point without a complete conversation log. I am criticizing the hyperbolic nature of the comment.

I doubt you are getting to the context level of model degredation where it reaches context limits within a verbal hour conversation.

I've just tried to recreate your example on sonnet 5, and as someone who has done DIY projects it reads completely appropriate, but I'm happy for criticism from a shed builder. It never once tells me about paper machie or creates a silly example.

This is via a prompt requesting tools and materials, and could be further improved, unfortunately, I can't paste the markdown formatting provided.

""" Reference size used below: 8x10 ft shed. Scale material quantities to your dimensions.

Step 1: Check Regulations & Plan Materials: None yet — just your design/plan (graph paper or free shed-plan software)

Tools: None

Skills to find: None required, but if your shed is large or near a boundary, a quick chat with your local planning/building department saves headaches later

What to do: Confirm permit requirements, setback distances from boundaries, and max height/size allowed without permission. Sketch your design and finalize dimensions.

Step 2: Prepare the Site Materials: Landscape fabric (weed barrier) Gravel/crushed stone (for drainage base, ~4-6 in depth) Marking spray paint or stakes + string

Tools: Shovel & spade Wheelbarrow Rake Hand tamper or plate compactor Spirit level (4 ft) or laser level Tape measure Builder's square (for squaring corners)

Skills to find: Basic site leveling — not hard, but a laser level rental helps a lot if the ground has any slope If you have poor drainage/heavy clay soil, worth asking a landscaper for advice What to do: Clear vegetation, mark the footprint, excavate and level, add compacted gravel base for drainage.

... """

I won't include the whole document, can share it further but anyone can replicate just by asking sonnet

I just don't understand the need for such hyperbole, and pretending that models are still gpt3, when you can get counter evidence in seconds.

It reminds me of the craze teachers had against trusting Wikipedia - yes, you shouldn't take all claims at face value, but arguing that nothing from Wikipedia could be useful just makes the argument silly.