Truncating Bar Graphs Persistently Misleads Viewers
sciencedirect.com
sciencedirect.com
Not that there is an incentive for most media organizations to present information in a reasonable way, would lower traffic and engagement.
Also vaguely related to my pet peeve of using large denominators to make numbers large and confusing. This factory produces 63M items a year! How about 2 per second, I can visualize 2.
smaller denominators can also be misleading though. maybe this is just me, but I usually read the denominator as implying a time period over which the figure is stable. for example, before the pandemic, I drove about 40 miles/day. I really did drive 20 miles each way to work pretty much every day. another way of saying this is that I drove 1.6 miles/hour every work day. true on average but kinda misleading when I spent 23 hours out of the day not driving at all.
it might not matter much to your example, but the factory probably didn't produce two items every second. there were probably shift changes, or maybe it stopped production for a few hours every night. depending on market conditions, it might have produced more on some days than others, and so forth.
Example:
.15% or half a million Americans died. What policy changes if any should we enact to try to compromise between lives lost and GDP, as lower GDP compromises (for instance) our influence in the international community.
Versus:
Side 1: it was less than one in 800 people. This is hysteria.
Side 2: What do you mean hysteria, we lost HALF A MILLION PEOPLE and it could have been 3 million if we had done it your way.
Side 1: 1 in 800 is not that many.
Side 2: 1 in 800 is a lot, actually.
appropriate context would be a breakdown of what x consists of, not just what it was last time period, and how that changed over time. then viewers can decide for themselves what's reasonable as a whole budget based on its parts. appropriate visualizations can provide breakdowns like this without much added complication.
but as you noted, letting readers think for themselves is not in the interests of the media, whose power lies in the control they can exert on what we think.
The examples show Fox News-levels of graph manipulation, i.e. maximum manipulation.
This is clearly done in an attempt to communicate a particular message. If you read the questions as "What message was the author trying to communicate?", which is reasonable, then the study could show that you were willing to repeat back the author's intended message.
In this sense, you weren't fooled by the graph - you understood exactly the message it was intended to convey.
A truncated graph is, in my opinion, completely appropriate for data where the relative differences or trends in data points is more relevant to the message than the absolute values - a temperature chart, say (where the absolute values are pretty much meaningless).
If you took data of a clearly relative type rather than a clearly absolute type, would you be able to say that viewers were misled in the exact opposite direction? That would be interesting.
The problem are truncated bar graph. Using a truncated bar graph is never a good idea.
For example if you are measuring the length of optical fibre and the difference between the lengths of fibres is 5cm over 100km, is that important in the context? You'll already lose several metres of length in various loops and coils that are important for reliable function of that 100km length of fibre.
On the other hand when cutting frames for doors, the difference of a couple of millimetres over the two metre length of the side of the frame can make the difference between passing or failing the building envelope pressurisation test.
On the gripping hand when I'm shooting an arrow 50m to a target, what's of interest to me is not the distance from me to the arrow but the tiny variances in distance from the arrow to the bullseye. So measuring the vector from me to the arrow is pointless and the centimetre or two difference in length of those vectors is meaningless.
> While discussions of misleading graphs are not new (e.g., Huff, 1954), empirical research on their assumed consequences is scattered across fields.
So on the surface, at least, this looks like just another paper belabouring the obvious.
Curious what biases one might also find based on color intensity of bars & varying widths
Not sure how to balance out this idea with log scales, which can be useful, but require a bit more care in visually digesting
In my early physics training the importance of putting error bars on data points was stressed, allowing for a visual comparison of the difference between two points in standard deviations.
His books are really good sources for learning to do this data-presentation well.
After all this exact form of misleading graph was one of the topics in the famous book How to Lie With Statistics written in 1954. And I don't think that the observation was new then.