Skip to main content

When Infographics Fail

There are a lot of bad infographics floating around the Internet.  When they concern things like the difference between cats and dogs, or how many hot dogs and hamburgers Americans eat over the 4th of July, it's no big deal.

But this blog is about higher education data, and when I see bad infographics on that topic, I feel compelled to respond.  This one is so bad it's almost in the "I can't even," category.  It takes very interesting and compelling data--The graduation rates of Black male athletes--and compares it to overall graduation rates at several big football schools in the nation.  Here it is:


For starters, this chart appears to stack bars when they shouldn't be stacked: A graduation rate of 40% for one group and 40% for another group shouldn't add up to 80%.  The effect is that it distorts much of what your brain tries to figure out.  For instance, look at the overall rates (longer bars) for Georgia Tech and Pittsburgh;  Georgia Tech at 79% is shorter than Pittsburgh's at 77%, because they started at different points.

But wait, they can't be stacked; Louisville's 44% + 47% is way longer than Notre Dame's 81%. Stacked bars on dual axes?

These also look at first like they could be two sets of bars, with one (the overall graduation rate, which is always higher) behind the Black male graduation rate.  But that can't be, either.  The effect is that you look at Notre Dame and see very long gap between 81% and 96% (a 15-point spread) that appears to be longer than the 37-point spread at Virginia.

In short, I cannot tell you how this chart was made, or what the assumptions are, let alone what the story really is.

And the image behind the picture is even worse; it makes it hard to see.

Finally, a third element might have been interesting here: The graduation rate of Black males who are not athletes.  It might shed more light on the problem, although if the same designer did it, I'd not be confident.

Here's the data presented three ways, each of which tells the story differently, but each better in at least one way. This was literally 15 minutes of work.

What do you think?






Comments

Post a Comment

Popular posts from this blog

Changes in AP Scores, 2022 to 2024

Used to be, with a little work, you could download very detailed data on AP results from the College Board website: For every state, and for every course, you could see performance by ethnicity.  And, if you wanted to dig really deep, you could break out details by private and public schools, and by grade level.  I used to publish the data every couple of years. Those days are gone.  The transparency The College Board touts as a value seems to have its limits, and I understand this to some extent: Racists loved to twist the data using single-factor analysis, and that's not good for a company who is trying to make business inroads with under-represented communities as they cloak their pursuit of revenue as an altruistic push toward access. They still publish data, but as I wrote about in my last post , it's far less detailed; what's more, what is easily accessible is fairly sterile, and what's more detailed seems to be structured in a way that suggests the company doesn...
Post a Comment
Read more

The Highly Rejective Colleges

If you're not following Akil Bello on Twitter, you should be.  His timeline is filled with great insights about standardized testing, and he takes great effort to point out racism (both subtle and not-so-subtle) in higher education, all while throwing in references to the Knicks and his daughter Enid, making the experience interesting, compelling, and sometimes, fun. Recently, he created the term " highly rejective colleges " as a more apt description for what are otherwise called "highly selective colleges."  As I've said before, a college that admits 15% of applicants really has a rejections office, not an admissions office.  The term appears to have taken off on Twitter, and I hope it will stick. So I took a look at the highly rejectives (really, that's all I'm going to call them from now on) and found some interesting patterns in the data. Take a look:  The 1,132 four-year, private colleges and universities with admissions data in IPEDS are incl...
Post a Comment
Read more

Changes in SAT Scores after Test-optional

One of the intended consequences of test-optional admission policies at some institutions prior to the COVID-19 pandemic was to raise test scores reported to US News and World Report.  It's rare that you would see a proponent of test-optional admission like me admit that, but to deny it would be foolish. Because I worked at DePaul, which was an early adopter of the approach (at least among large universities), I fielded a lot of calls from colleagues who were considering it, some of whom were explicit in their reasons for doing so.  One person I spoke to came right out at the start of the call: She was only calling, she said, because her provost wanted to know how much they could raise scores if they went test-optional. If I sensed or heard that motivation, I advised people against it.  In those days, the vast majority of students took standardized admission tests like the SAT or ACT, but the percentage of students applying without tests was still relatively small; the ne...
Post a Comment
Read more