Monday, June 4, 2012

High School Rankings Give Skewed View Of Campus Performance

The New York Times' Michael Winerip has a thoughtful take on how the popular practice of ranking high schools -- including Newsweek Magazine's vaunted list -- can result in a skewed view of campus performance.

Various publications, including U.S. News & World Report and the Daily Beast, use formulas that typically rank schools based how many students take Advanced Placement and International Baccalaureate classes, and then score well on the related exams. Some of the formulas give schools credit for graduation rates and college-going rates. U.S. News' rankings this year were marred by reports of faulty data  for two campuses in the Top 20. The problem stemmed from incorrect figures reported to the U.S. Department of Education's Common Core of Data, the federal database used by the publication to gather information about schools.

Winerip argues that these numerical compilations can't truly reflect how well a school is truly serving its students. If such lists were to be believed, Winerip said, parents looking for the top schools for their children might consider avoiding the midwest altogether, as Newsweek has deemed it "an educational wasteland."

Indeed, given the problems with U.S. News' rankings, it's important to remember that the accuracy of such rankings isn't always a given. At the same time, Winerip's concern "that the lists are stacked," is a fair one.

"Schools with the greatest challenges can appear to be the biggest failures," Winerip wrote. "At a time when public education is so data-driven, that kind of thinking can cost dedicated teachers and principals their jobs."

To be sure, schools serving more affluent communities are more likely to appear high on the list. So are campuses that are able to practice some form of selective enrollment. 

When the annual high school rankings come out, I've often wondered if it's even reasonable to include magnet campuses, which are public schools that offer specialized programs in areas such as science, math and technology. The enrollment is typically determined by a competitive application process, and magnet schools draw standout students who are highly motivated to succeed. Given those factors, why even include them in the rankings of traditional campuses that must accept every student who enrolls?

When I broached this topic with Robert Morse, U.S. News' director of data and research, in an interview last month, he called it a fair question. But from the publication's perspective, "a public school is a public school," Morse told me. He pointed out that the elite programs are free to attend, "even if there are some barriers to entry."

School districts have set up magnet campuses "for a reason, and they are competing with other public schools," Morse said. "By including them in the rankings, it shows that these types of schools are producing really good results, and that deserves to be pointed out.”

Have a question, comment or concern for the Educated Reporter? Email EWA public editor Emily Richmond at erichmond@ewa.org. She also tweets @EWAEmily.

Labels: , , , , , , ,

3 Comments:

Blogger caroline said...

These lists are complete BS, a disgrace to journalism. They bring shame on the entire profession (or what's left of it).

A suburban high school here in the San Francisco Bay Area, Dublin High School, ranked startlingly high. The principal immediately said that yes they're a good school, but that that sky-high ranking was a mistake. Turns out it was based on wrong figures. Well, just ONE like that discredits the entire fiasco. I believe they've owned up to three, and who would believe that was all?

My own kids' high school ranked high, but it's a magnet school, so everybody with any ethics at all says c'mon, don't brag about it, since it's BS.

The EWA should step up, denounce and discourage these projects. They mislead readers, which is a mortal journalistic sin.

June 4, 2012 at 2:28 AM  
Anonymous Kevin Welner said...

I'm not sure I'd go the "complete BS" route, but it's pretty close. A key problem with these rankings is similar to the NCLB problem: when we evaluate based on a narrow set of criteria, we do two things: (1) we neglect other important considerations, and (2) we distort the measure itself, because if the stakes are high enough the ranked institutions will game the system.

The US News college rankings are the poster child for this, having prompted (among other gaming) the "early admissions" boom. See http://dukecheck.com/?p=1634 and http://rethinkingadmissions.blogs.wfu.edu/tag/u-s-news/

That these rankings can prompt changed practice is no secret to those who conduct them. In fact, the advocacy group "National Council on Teacher Quality" (NCTQ -- see http://www.washingtonpost.com/blogs/answer-sheet/post/ravitch-what-is-nctq-and-why-you-should-know/2012/05/23/gJQAg7CrlU_blog.html) has reached an agreement with US News to generate rankings of education schools/depts that would align with NCTQ's policy agenda.

While a ranking can be no more than an engaging subjective list (my favorite bands, movies, etc.), when it takes on a "News" imprimatur and the resulting rankings are treated by many as fact or truth, it can indeed become problematic, with private organizations driving policy through process that is in many ways misleading.

June 7, 2012 at 3:58 PM  
Blogger caroline said...

The FORMER Newsweek high school rankings are up there too -- the ones that rated schools based entirely on the number of AP tests taken per capita (not even on the results of the tests -- just how many were taken).

Hey, how about ranking newspapers and magazines? Let's create some simple criteria. Where will yours rank, everybody?

June 11, 2012 at 3:22 PM  

Post a Comment

Considerate comments are welcome. Uncivil remarks will be deleted. Anonymous comments -- including those unaccompanied by the author's first and last name -- are not permitted.

Subscribe to Post Comments [Atom]

Links to this post:

Create a Link

<< Home