Skip to main content

Important Notes

The work here is all mine; my wife tells me I occasionally make mistakes.

This is for informational purposes only, and although I believe what's represented here reflects the original data, there may be errors in my calculation or visualization, or in the original data itself.  I almost always link to the data source, and there are often disclaimers there, too.  Be sure to check them out.

Don't make any bar bets--or worse--strategic planning decisions based on what you read here without verifying the information for yourself.



This blog uses data from several sources.  Each has advantages and limitations.

IPEDS: The Integrated Postsecondary Education Data System.  I mostly use the IPEDS Data Center. Colleges and Universities that receive Title IV funding are required to submit data annually to IPEDS, which means you can find information on almost any college you're interested in.  Unfortunately, the data is not adjudicated, and it's obvious that the surveys for some smaller colleges are completed by people who don't understand the business or the information system they're using.

Additionally, surveys lag reality; the enrollment data for fall 2013, for instance, won't be available until sometime in summer or fall 2014 (in a good year); finance and financial aid are a year behind that.

Newbies to IPEDS find the site hard to work with, and I agree.  But overall, the amount and quality of data makes the effort worth it.

NCES Digest of Education Statistics: I first found this resource in the mid-1990's and it has saved my bacon a couple of times.  Good, summarized, and often longitudinal data about all levels of education in the US. These are pre-formatted reports (designed to be printed) and are nothing short of horrible to use with a data tool.  But when the information is good, it's worth it, even though you'll probably spend 95% of your time just getting the data right and clean.

College Board Trends in Higher Education: Good, summarized data on a wide variety of topics including pricing, aid, access, and outcomes.  Compiled from reliable sources by good data people, this information is usually downloadable in Excel but has some of the problems of the Digest when you try to make it ready for data visualization. 

IPUMS: The Integrated Public Use Microdata Series uses US Census Bureau data from the American Community Survey to provide astonishingly detailed data at the granularity of a single person.  Samples run from 1% of the population to 5%; and from one to three years.  Big files, and a bit hard to tackle, but really good stuff if you want to dig deep and ask complex questions of the population.

WICHE: The Western Interstate Commission for Higher Education publishes a lot of studies and white papers on best practices, but the most important thing they do is their "Knocking at the Door" projections of high school graduates looking forward by a decade or more.  It's not user friendly, but I've downloaded and combined the files into this visualization.

Data-dot-Gov:  This site has loads of good data (or links to it), some of it related to higher education.  You can spend a lot of time getting lost in this site, looking at things like FAA Investigations, locations of military veterans' grave sites, or "milk."

My Favorite Tool: And finally, the tool I use is Tableau Software. It's designed to allow even non-technical people the ability to ask questions of their data, and to get insight very quickly.  I almost always put the source of the data I use on my visualizations (or at least in the body of the blog post), and I encourage people to look at the NCES table, for instance, and the visualization to see which makes more sense.  I hope I'm successful in turning some data into insight.

You'll find the Tableau Community to be very smart, engaged, helpful, and encouraging as you try to make some sense out of your own numbers.  There are free versions of the software available, and you can publish your work to a public server to share with the world, and embed your visualizations into many blogs, including, obviously, Blogspot (Wordpress, not so much.)  

I consider myself a Tableau Dabbler, or perhaps an advanced beginner, very cognizant of my own limitations, but I'm happy to help any way I can.  Just drop me a note or give me a call.




Comments

Popular posts from this blog

Changes in AP Scores, 2022 to 2024

Used to be, with a little work, you could download very detailed data on AP results from the College Board website: For every state, and for every course, you could see performance by ethnicity.  And, if you wanted to dig really deep, you could break out details by private and public schools, and by grade level.  I used to publish the data every couple of years. Those days are gone.  The transparency The College Board touts as a value seems to have its limits, and I understand this to some extent: Racists loved to twist the data using single-factor analysis, and that's not good for a company who is trying to make business inroads with under-represented communities as they cloak their pursuit of revenue as an altruistic push toward access. They still publish data, but as I wrote about in my last post , it's far less detailed; what's more, what is easily accessible is fairly sterile, and what's more detailed seems to be structured in a way that suggests the company doesn...

The Highly Rejective Colleges

If you're not following Akil Bello on Twitter, you should be.  His timeline is filled with great insights about standardized testing, and he takes great effort to point out racism (both subtle and not-so-subtle) in higher education, all while throwing in references to the Knicks and his daughter Enid, making the experience interesting, compelling, and sometimes, fun. Recently, he created the term " highly rejective colleges " as a more apt description for what are otherwise called "highly selective colleges."  As I've said before, a college that admits 15% of applicants really has a rejections office, not an admissions office.  The term appears to have taken off on Twitter, and I hope it will stick. So I took a look at the highly rejectives (really, that's all I'm going to call them from now on) and found some interesting patterns in the data. Take a look:  The 1,132 four-year, private colleges and universities with admissions data in IPEDS are incl...

Changes in SAT Scores after Test-optional

One of the intended consequences of test-optional admission policies at some institutions prior to the COVID-19 pandemic was to raise test scores reported to US News and World Report.  It's rare that you would see a proponent of test-optional admission like me admit that, but to deny it would be foolish. Because I worked at DePaul, which was an early adopter of the approach (at least among large universities), I fielded a lot of calls from colleagues who were considering it, some of whom were explicit in their reasons for doing so.  One person I spoke to came right out at the start of the call: She was only calling, she said, because her provost wanted to know how much they could raise scores if they went test-optional. If I sensed or heard that motivation, I advised people against it.  In those days, the vast majority of students took standardized admission tests like the SAT or ACT, but the percentage of students applying without tests was still relatively small; the ne...