Hacker News Reader

Comment by simonw | Hacker News Reader

This is SVG, but recent Anthropic models have got extremely good at other forms of visual data.

Here's a Blender model I had Claude Opus 5.5 create: https://tools.simonwillison.net/blender-viewer?url=https%3A%...

And here's some animated pixel art by Opus 5.5: https://tools.simonwillison.net/kakapo-party

And some Monkey Island style music (Opus can compose music too): https://tools.simonwillison.net/scrimshaw-jukebox

Anthropic's models do all of this by outputting code. GPT-6 Astra has similar capabilities - I got this Blender model using that: https://tools.simonwillison.net/blender-viewer?url=https%3A%...

View on HN

Pardon, I have a lot of questions about that Scrimshaw music text format. It's clever. Did you invent it, and is it specifically intended to be written to by LLMs? Is the editor/player LLM-coded as well, and was this its recommendation for a format that would be easy for LLMs to write? I'm wondering why this instead of say, asking it to write a .MOD file.

Opus invented it, and wrote the player, and the songs.

My prompts were:

> I want you to write some computer game music for me. First design simple text based format for the music and build an artifact that can play it out loud - include some example tracks in that artifact

> I am looking for music of the quality of the original secret of Monkey Island

And then later:

> Modify scrimshaw jukebox to add a copy-paste prompt that explains the music format, it should be shown at the bottom of the page below the readable instructions, the prompt should be designed to help any LLM tool compose music in the correct format. It should have a copy to clipboard button.

https://claude.ai/share/1f721c20-2499-4d23-b368-3ab57146d956 and then https://claude.ai/code/session_01R3xuRtjVHqHo1GNbget6Tu

I have been using these models to make 3d models with build123d — they are great at it. I am never touching Fusion again. Astra is current a bit better than Opus 5.5.

They are really good at generating artifacts, which are windows within the replies containing all kind of visualization, often interactive.

They are still not great at SVG. I just asked Opus and Fable to add a background to an SVG and the results were, well, not great.

SVG is hard.

I’ve had it transcribe speech from images of a waterfall viz

What was the prompt for the widow's bay egg?

I pasted in a concept image (created by ChatGPT images here https://chatgpt.com/share/6ac16336-c288-83e8-9f28-084d184363...) and prompted:

> Use your blender local skill to create a blender model of this faverge egg

The blender local skill is this one: https://github.com/simonw/gpt-6-astra-blender-pelican-bicycl... - which I described here: https://til.simonwillison.net/llms/blender-coding-agents-mac...

This is great! Love the pixel art and tunes.

Tried it with GPT-6 Astra with Ultra but the outcome was underwhelming with Blender. Maybe it was my prompting ¯\_(ツ)_/¯

Reply on news.ycombinator.com