Do disadvantaged 12th graders score the same as well-off 8th graders?
Reading Wendy Kopp’s new book, I came upon a frequently used factoid: that students in poor areas “who do graduate will read and do math, on average, at the level of eighth graders in high-income areas.” The footnotes cite 2005 NAEP data. Usually I see this equivalency used in terms of race: black twelfth graders performing at the level of white eighth graders.
When I was writing Tested, I tracked down the specific data so that I could use it to illustrate the achievement gap. I spoke with three people who work on NAEP. One, a communications specialist, was comfortable with this use of NAEP data. But two psychometricians there confirmed what I was worried about: that the scales for the two tests were not aligned so that you could compare students across tests. So I found other ways to illuminate the gap—and you probably should too, unless the NAEP team has changed the metrics to make this sort of comparison appropriate.
When I was writing Tested, I tracked down the specific data so that I could use it to illustrate the achievement gap. I spoke with three people who work on NAEP. One, a communications specialist, was comfortable with this use of NAEP data. But two psychometricians there confirmed what I was worried about: that the scales for the two tests were not aligned so that you could compare students across tests. So I found other ways to illuminate the gap—and you probably should too, unless the NAEP team has changed the metrics to make this sort of comparison appropriate.


1 Comments:
You are right, and I've tried pointing this out in numberous places.
Thank you for bringing more attention to this quiet common error.
Post a Comment
Considerate comments are welcome. Uncivil remarks will be deleted. Anonymous comments -- including those unaccompanied by the author's first and last name -- are not permitted.
Subscribe to Post Comments [Atom]
Links to this post:
Create a Link
<< Home