Bad Chart Thursday: Nielsen’s Pretty . . . Useless Charts
If you’ve ever seen a Nielsen report or article, you’ve seen the company’s charts. In fact, the reports often read more like brochures, as though marketing their market research is more important than the research itself, with a heavy focus on presenting the data in a visually appealing way, often at the expense of clarity.
Case in point, the meaningless Venn diagram:
In a way, it’s actually worse than meaningless because it implies no overlap in the outlying categories, as though no Hispanic Boomers ever choose ready-to-drink coffee, for example. A Venn is just not a useful chart for information that doesn’t fall into discrete categories outside the overlap. Not to mention the unclear category definitions. Where would home-brewed coffee fit in? And is deli coffee really that popular among both age groups? Unfortunately, the article where this chart appears says nothing about this chart or even coffee. But hey, the colors are pretty.
And then there’s this chart connecting data about social network users with various points on a shadow woman’s body for no discernible reason. Are these demographic chakra points? Or perhaps this is a subtle commentary on how the gender binary is all in our head, home is where the stomach is, and we’re only as old as our clavicle.
In keeping with the trend of using the wrong chart for the job, we have this pair of charts from Nielsen’s African-American Consumer 2013 Report. (Note that “basket ring” apparently refers to annual retail spending, not the metal part of a basketball hoop, woven jewelry, or the mark left by your laundry basket because you kept buying new socks and underwear instead of washing clothes.)
Both are intended to show comparisons between two sets of data, but the numbers are so close to each other that there isn’t a clear distinction in size between the green and the blue in either chart. Side-by-side vertical bars, for example, would show us at a glance the slight differences.
The meaning of “Total US” is also unclear. At first I thought that it was an insensitive way to refer the non-black population, as though black people were not part of the total US, but Nielsen’s use of “total market” elsewhere clarified that it includes the comparison group as well as the rest of the population. The report itself makes clear that these numbers are averages, but that would be useful to include in the chart title or labels.
Yet the text accompanying these charts only confused me more, including comparisons between black and non-black people’s shopping habits, so I ran the charts and accompanying text by our resident statistician Jamie Bernstein in the Skepchick backchannel. (See an image of the page here.)
She helped clarify what I was looking at and pointed out additional problems in the analysis, the most egregious being their statement that “African-Americans’ annual retail spending or ‘Basket Ring’ is 87% of Total Market retail spending.” This would be astonishing if true, given that just over 13% of the US population is black. The number seems to clearly come from the third ring in the chart above, but that shows average per household, not total retail spending numbers. As Jamie put it, “I really think they got confused by their own ring chart.”
The Nielsen Company sells its services to marketing departments, so it’s not a huge surprise or even all that unreasonable that they would lean more toward the infographic when presenting data, but I could have presented many more examples of unclear charts here. (See a selection of their charts in one place here, though it’s biased toward what people would consider interesting enough to pin on Pinterest.) Even more important, I could provide examples of charts they’ve done that are both clear and visually appealing. The choice between the two reflects the difference between a market research firm and a marketing company that does research.