I got Claude to port those Bash scripts to a web UI so I could paste code directly into it and see what came out: https://tools.simonwillison.net/writing-style
Claude transcript here: https://gist.github.com/simonw/e9902ed1cbda30f90db8d0d22caa0...
Claude transcript here: https://gist.github.com/simonw/e9902ed1cbda30f90db8d0d22caa0...
It is quite difficult to find untainted samples. We used various methods to isolate four samples.
it gives Found "quite" in: "is quite difficult to find untainted samples."
Found "various" in: ""
Otherwise great work, I like these very fast html/js tools. const words = text.toLowerCase().split(/\b/)
vs const words = text.split(/\s+/)New version is now live at https://tools.simonwillison.net/writing-style
I've actually had a tiny bit of trouble using LLMs for writing analysis in the past, though that was more about spell checking. I found they often missed obvious errors, probably because the tokenization step means they don't "see" the exact original prose in a way that makes those errors as obvious as they are to me.