Skip to main content

Do test-optional policies increase diversity?

If you want a definitive answer, you can stop now.  As Mark Twain allegedly said, "I was gratified to be able to give an answer right away.  I said I didn't know."

However, critics of test optional like to trot out this study from 2014, suggesting test-optional policies do not increase diversity. There are a couple of problems with using that paper to prop up this argument, however: First, the study included about 200 liberal arts colleges, and nowhere does it suggest that the conclusions can be generalized, or even that the results are reflective of reality every where else.  Second, the study explicitly states that the SAT sorts students by social class, not just academic ability.  You can't cite the outcomes without including lines like, "Despite the clear relationship between privilege and standardized test performance..." but somehow test lovers overlook that.  Finally, admissions, opportunity, culture, and policy are complex.  The belief that waving a wand will somehow address centuries of differing opportunities might be, um, naïve.  At best. 

There are some problems with leaping to conclusions about the data here, too.  You'll notice that between 2019 (the last normal year before COVID) and 2021 (the first year things returned to something closer to normal), that most selective (more about that) institutions did, in fact, become more diverse.  You'll also notice, perhaps, the big drop in African American enrollment at the University of Florida, one loud resistor of test optional during the pandemic.  It would be a mistake to draw facile conclusions based on what you see here.

Beyond that, there are two other reasons to temper your test optional enthusiasm about the results here.  First, the population of high school graduates is getting more diverse.  Some of this could be a natural remnant of that demographic reality.  Perhaps more important, however, is that IPEDS data only includes enrolling students, not admitted students.  Admissions offers the opportunity to enroll, but enrollment is driven by the student after factoring in many other factors.  So we don't know what the admit pools look like.  That would be critical, of course.

The final view allows you to look at all institutions, but for the others, I've used selectivity as a factor in the display.  This is because most institutions admit a very large percentage of applicants; the shape of their class is often largely driven by who applies, and we know COVID ramifications still affected student behavior and preparation.  It's only at those colleges and universities that are selective, and that can shape their class, that test optional policies really have a dramatic affect.

So, the viz:  Only the last view is interactive.

The first view (using the tabs across the top) shows the Ivy League, plus MIT and Stanford, and the total first-year enrollment by ethnicity.

The next two show those same institutions, broken out by college, year, and ethnicity: First, African American and then Hispanic.  The data show numbers and percentage of the first-year, degree-seeking students.

Next are selective (admit rates of less than 50%) public land grant and flagship institutions, using a similar format.

And finally, the final view is more interactive but less granular.  Find your region, control, Carnegie rollup, selectivity, and specific ethnicity, and the display updates for you.

We won't know about this until some deeper analysis happens, but for now, I think the signs are good.  Time will tell.

As always, if you find something you think is interesting, comment or drop me a line.


Comments

Popular posts from this blog

Changes in AP Scores, 2022 to 2024

Used to be, with a little work, you could download very detailed data on AP results from the College Board website: For every state, and for every course, you could see performance by ethnicity.  And, if you wanted to dig really deep, you could break out details by private and public schools, and by grade level.  I used to publish the data every couple of years. Those days are gone.  The transparency The College Board touts as a value seems to have its limits, and I understand this to some extent: Racists loved to twist the data using single-factor analysis, and that's not good for a company who is trying to make business inroads with under-represented communities as they cloak their pursuit of revenue as an altruistic push toward access. They still publish data, but as I wrote about in my last post , it's far less detailed; what's more, what is easily accessible is fairly sterile, and what's more detailed seems to be structured in a way that suggests the company doesn...

Educational Attainment and the Presidential Elections

I've been fascinated for a while by the connection between political leanings and education: The correlation is so strong that I once suggested that perhaps Republicans were so anti-education because, in general, places with a higher percentage of bachelor's degree recipients were more likely to vote for Democrats. The 2024 presidential election puzzled a lot of us in higher education, and perhaps these charts will show you why: We work and probably hang around mostly people with college degrees (or higher).  Our perception is limited. With the 2024 election data just out , I thought I'd take a look at the last three elections and see if the pattern I noticed in 2016 and 2020 held.  Spoiler: It did, mostly. Before you dive into this, a couple of tips: Alaska's data is always reported in a funky way, so just ignore it here.  It's a small state (in population, that is) and it's very red.  It doesn't change the overall trends even if I could figure out how to c...

Changes in SAT Scores after Test-optional

One of the intended consequences of test-optional admission policies at some institutions prior to the COVID-19 pandemic was to raise test scores reported to US News and World Report.  It's rare that you would see a proponent of test-optional admission like me admit that, but to deny it would be foolish. Because I worked at DePaul, which was an early adopter of the approach (at least among large universities), I fielded a lot of calls from colleagues who were considering it, some of whom were explicit in their reasons for doing so.  One person I spoke to came right out at the start of the call: She was only calling, she said, because her provost wanted to know how much they could raise scores if they went test-optional. If I sensed or heard that motivation, I advised people against it.  In those days, the vast majority of students took standardized admission tests like the SAT or ACT, but the percentage of students applying without tests was still relatively small; the ne...