Compare sentence length distributions of famous authors

Tried it on Brave New World, which contains this massive 250-worder near the start (but it turns out the rest is pretty typical):

> Still leaning against the incubators he gave them, while the pencils scurried illegibly across the pages, a brief description of the modern fertilizing process; spoke first, of course, of its surgical introduction–"the operation undergone voluntarily for the good of Society, not to mention the fact that it carries a bonus amounting to six months' salary"; continued with some account of the technique for preserving the excised ovary alive and actively developing; passed on to a consideration of optimum temperature, salinity, viscosity; referred to the liquor in which the detached and ripened eggs were kept; and, leading his charges to the work tables, actually showed them how this liquor was drawn off from the test-tubes; how it was let out drop by drop onto the specially warmed slides of the microscopes; how the eggs which it contained were inspected for abnormalities, counted and transferred to a porous receptacle; how (and he now took them to watch the operation) this receptacle was immersed in a warm bouillon containing free-swimming spermatozoa–at a minimum concentration of one hundred thousand per cubic centimetre, he insisted; and how, after ten minutes, the container was lifted out of the liquor and its contents re-examined; how, if any of the eggs remained unfertilized, it was again immersed, and, if necessary, yet again; how the fertilized ova went back to the incubators; where the Alphas and Betas remained until definitely bottled; while the Gammas, Deltas and Epsilons were brought out again, after only thirty-six hours, to undergo Bokanovsky's Process.

I probably need to add more context to the page, but I want to specify that my intention with this tool wasn't that long sentence == bad. I was inspired by this image:

https://twitter.com/misscrisp/status/1202792895448662016

It's really interesting how different authors play with the rhythm of their sentences - one of the best ones on here is The Raven, with very short sentences interspersed with longer ones.

Is it a valid comparison if they're comparing sentence length of translations of works originally written in other languages? For example, Hermann Hesse's Siddhartha and Plato's Republic.

This reminds me of an app I wrote a few years ago when learning R: https://mzgw.shinyapps.io/book-recommendation/

My friend needed a way to determine the Flesch-Kincaid readability score for a selected paragraph, and was using Microsoft Word for that. I wrote a script to automatically parse the scores for all txt files provided, then started to wonder how different books fared in that aspect, how readability scores map to language proficiency levels, and what can be told about the book in general using simple analysis tools. It was a fun project but the readability scores were far from expected — eg I hate Joseph Conrad’s Heart of Darkness and always find it frustrating to read but the readability score is actually not that low.

I was disappointed not to see Paradise Lost by John Milton. His sentences are some of the longest I have ever come across.

It looks like this fails on initialisms. For example, it counts this as three sentences:

>The agency responsible for it, the U.S. Bureau of Reclamation, would build the highest and largest dams in the world on rivers few believed could be controlled.

Heh. For fun I put in a bit of "Within a Budding Grove" (one of the Proust books [1]) and it's almost entirely in the yellow region, even with my bad copy-paste job that chops up sentences by accident. Proust is fun to read, but it took me a while to get the way he talks.

[1] https://www.planetebook.com/free-ebooks/within-a-budding-gro...

Sentence length is pretty arbitrary considering that in many cases the choice of whether to insert a sentence-ending full stop is arbitrary. Almost any period can be replaced with a semicolon. And what should you do with a clause that starts with "however"? Should it be a separate sentence, or attached to the previous one with a comma or a semicolon? So I've never considered sentence length to be very meaningful.

A lot of the average sentence lengths in the examples were fairly similar. Ran the texts through an ARI readability test: The Twain was 'grade school' while the Hesse was 'college level'.

Seemed pretty similar to me. Dialog is mostly short interjections, while scene exposition and monologues were longer.

While the viz is nice some numbers would but mucho mas nicer

Also everyone should read pride and prejudice because it’s funny as hell