Skip to main content

NY City Public Schools, and what they might tell us about the SAT

Recently, I received a message from Akil Bello who pointed out a data visualization he had seen.  It was originally posted to Reddit, but later was edited to eliminate the red-green barrier that people with color-blindness face.  The story was here, using a more suitable blue-red scheme.

There's nothing really wrong with visualizing test scores, of course.  I do it all the time.  But many of the comments on Reddit suggest that somehow the tests have real meaning, as a single variable devoid of any context.  I don't think that's a good way to analyze data.

So I went to the NY City Department of Education to see what I can find.  There is a lot of good stuff there, so I pulled some of it down and began taking a look at it.  Here's what I found.

On the first chart, I wanted to see if the SAT could be described as an outcome of other variables, so I put the average SAT score on the y-axis, and began with a simple measure: Eighth grade math and English scores on the x-axis. Hover over the regression line, and you'll see an r-squared of about .90.

Scientists would use the term "winner, winner, chicken dinner" when getting results like this.  It means, for all intents and purposes, that if you know a high school's mean 8th grade achievement scores, you can predict their SAT scores four years later with amazing accuracy.  And--here's the interesting thing--the equation holds for virtually every single school.  There are few outliers.

Ponder that.

But critics of the SAT also say that the scores are reflective of other things, too; an accumulation of social capital, for instance.  So use the control at the bottom to change the value on the x-axis.  Try economic need index, or percentage of students in temporary housing, or percentage of the student body that are White or Asian. The line may go up (positive correlation) or down (negative) but you'll always see the schools with the highest scores tend to have the characteristics you'd expect.

Jump to the second tab.  This is more a response to the Reddit post: The top map shows the ZIP codes and a bubble, indicating the number of schools in that ZIP.  The bottom map shows every school arrayed on two poverty scales: Economic Index and Percent in Temporary Housing.  The color shows the mean SAT score in the school (Critical Reading plus Math, on a 1600-point scale.)  Purple dots represent higher scores.

Use the ZIP highlighter, and you'll see the top map show only that bubble, and the bottom will show the schools in it.

Got the lesson?  Good.  Now, think about why the colleges with high median test scores a) have them, and b) tend to produce students with high GRE and MCAT and LSAT scores,  and c) point to excellent outcomes for their students.

And let me know what you think.






Comments

Popular posts from this blog

Another 1000 Words and Ten Charts on First-generation, Low-income, and Minority Students

I have always enjoyed writing, and I consider this and my other blog like a hobby.  Usually, I spend no more than 45 minutes on any post, as I don't make my living by writing, and my blogs are not "monetized." But once in a while, an opportunity presents itself to write for a wider audience, and that's when I see what it takes to make a living putting words to paper. That happened this week.

You may have seen my opinion piece in the Chronicle of Higher Education. If not, you can read it first, read it last, or not at all; I think both this and that stand alone, despite their relationship.  In the end, we ended up with about 40% of my first draft, which is what happens when you write for a print publication. And of course, a print publication makes interactive charts, well, difficult.

I think there is more to say on the topic, because the similarities in recruitment challenges for first-generation, low-income, and minority students tend to look a lot alike, and the mo…

2018 Admissions Data

This is always a popular post, it seems, and I've had a couple of people already ask when it was going to be out.  Wait no more.

This is IPEDS 2018 admissions data, visualized for you in two different ways.  You can switch using the tabs across the top.

The first view is the universe of colleges and universities that report data; not every college is required to, and a few leave data out, and test optional colleges are not supposed to report test scores.  But IPEDS is not perfect, so if you find any problems, contact the college.

On the first view, you'll see 1,359 four-year private and public, not-for-profit institutions displayed.  In order to make this as clean as possible, I've taken out some specialty schools (nursing, business, engineering, etc.) as many of those don't have complete data.  But you can put them back in using the filter at top right.

Hover over any bar, and a little chart pops up showing undergraduate enrollment by ethnicity.

You can also choose to…

Changes in Bachelor's Degrees, 2011-2017

This will probably be the final post in Higher Ed Data Stories for a while.  As you may already know, I'm leaving DePaul for the "best coast" to take the position of Vice Provost of Enrollment at Oregon State University, effective July 1.  Thus, I'll be in personal and professional transition for a while, and once I arrive, I'll be busy learning a new institution and working on new challenges that should keep me occupied for a while. (Additionally, I'm not sure what my Tableau situation will be like...)

As you may already know, HEDS got its start when I decided to revise and share work I was already doing in my job at DePaul. Much of it, I presumed, would be of interest to university colleagues and high school and independent counselors.  But I had no idea how many people craved information like this.

So, for now, here is information about bachelor's degrees earned in 2011, 2014, and 2017, the most recent available in the IPEDS data center.  It's pres…