Nobody Should Be Wasting Time Worrying About When to Administer Standardized Tests

Parents, children, teachers, principals, and school superintendents are living through a time of unknowns. COVID-19 is raging across the states with many public schools operating only online. Some public schools, which have been able to open in person or on hybrid schedules, have subsequently been forced to close already reopened buildings or specific classrooms as COVID-19 cases arise and everybody quarantines.

In the midst of a chaotic situation with no good and stable solutions for many public schools, suddenly last week everybody started worrying about what to do about this year’s standardized tests. The Washington Post‘s Perry Stein reports that outgoing Secretary of Education, Betsy DeVos postponed the winter administration of the National Assessment of Educational Progress, the one test administered across all the states, the test that tracks school achievement over the decades and is not distorted by high stakes consequences.

Representatives Bobby Scott (D-VA) and Patty Murray (D-WA), the Democratic leaders of the House Education Committee, agreed to delay the NAEP, but said the nation needs some kind of measure of learning loss during the pandemic.  They released a statement declaring that annual state tests mandated under the Every Student Succeeds Act must surely be administered: “Existing achievement gaps are widening for our most vulnerable students, including students from families with low incomes, students with disabilities, English learners, and students of color. In order for our nation to recover and rebuild from the pandemic, we must first understand the magnitude of learning loss that has impacted students across the country. That cannot happen without assessment data.”

While I frequently agree with Representatives Scott and Murray, I think worrying about standardized testing right now ought to be a low priority, and I think the state-by-state achievement tests mandated by the Every Student Succeeds Act are the wrong kind of test.  Neither do I believe that the mandated, annual state achievement tests are necessary to help teachers grasp their students’ learning needs during and following the widespread school closures and disruptions in the current school year.  Our schoolteachers are well trained professionals who are prepared to develop their students’ reading comprehension skills, to track problems with computational skills and mathematical conceptualization, and to help support their students emotionally after a period of disruption. The emphasis right now and when children return to classrooms must be supporting teachers facing the complex challenge of serving children who have been out of the classroom for too long. Standardized test scores very often don’t even arrive at schools for months after the tests are administered; they play little role in supporting teachers’ capacity to discern their students’ learning gains or losses.

If we are looking for complex data about the impact of the pandemic on public schools across communities and across states, at some point it will be realistic for the National Center for Education Statistics again to administer the National Assessment of Educational Progress, which is designed as a national audit test to determine learning trends over time.  When it is practical to administer NAEP, certainly that test should happen.

The annual standardized tests, mandated first by No Child Left Behind and, since 2015 by the Every Student Succeeds Act, are designed for an entirely different purpose.  And ironically the purpose and use of these tests for holding schools accountable distorts the results as schools struggle to raise scores at any cost in order to avoid the high stakes punishments that Congress attached to these tests or forced the states to attach. What are these high stakes? States still have to submit to the U.S. Department of Education plans for how to turnaround their lowest performing schools according to these tests.  Some states still evaluate teachers according to their students’ scores. States rate and rank particular schools and school districts according to their aggregate test scores. Many states publish these rankings, which encourages real estate redlining as well as racial and economic segregation across metropolitan areas. Different states place voucher programs or charter schools in school districts where scores are low. Some states take over low scoring schools and school districts and turn them over to appointed commissions that supplant locally elected school boards.  Some school districts have claimed to use school closure as a so-called turnaround plan.

In a profound 2017 book, The Testing Charade: Pretending to Make Schools Better, Daniel Koretz, a Harvard University expert on standardized testing, documents research exposing flaws in the entire strategy of No Child Left Behind, which combined standardized testing with high stakes punishments for schools unable quickly to raise students’ test scores. Koretz explains social scientist Don Campbell’s well-known theory describing the universal human response when high stakes are tied to a quantitative social indicator.  In this case, the social indicator is whether or not educators and particular schools can produce higher aggregate student test scores year after year:

“The more any quantitative social indicator is is used for social decision making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor… Achievement tests may well be valuable indicators of… achievement under conditions of normal teaching aimed at general competence. But when test scores become the goal of the teaching process, they both lose their value as indicators of educational status and distort the educational process in undesirable ways.” (The Testing Charade, pp. 38-39)

Koretz shows that imposing high stakes punishments on schools and educators unable quickly to raise students’ scores inevitably produces reallocation of instruction to what is being tested, causes states eventually to lower standards, causes some schools quietly to exclude from testing the students likely to fail. Under No Child Left Behind, the high stakes even led to abject cheating—as happened in Atlanta under Superintendent Beverly Hall.

What all this means is that the state achievement tests mandated by No Child Left Behind and the Every Student Succeeds Act—whether administered to students this year or put off until after vaccines are widely available and students return to their classrooms—are not an appropriate tool for measuring the long term impact of the pandemic on students’ lives and learning.

Ideological advocacy for holding public schools accountable drove the passage and implementation of the original No Child Left Behind Act. The idea was that educators can be motivated to work harder through fear if their schools are threatened with punishments.  The idea of attaching high stakes consequences for low test scores remains with us today. Last week Chester E. Finn, Jr., formerly of the Thomas B. Fordham Institute and now affiliated with the Hoover Institution, published a widely read column in the Washington Post.  Twenty years ago, Finn strongly promoted No Child Left Behind’s test-and-punish strategy, and clearly he continues to believe in using high stakes testing as a threat. Here is a paragraph from his recent column that Finn could easily have cut, pasted, and slightly updated from something he wrote back in 2001:

“The results from those state assessments are the main source of information about school performance and about pupil learning in the core subjects of the K-12 curriculum. The results also indicate whether America’s appalling — and persistent — achievement gaps are getting any narrower. These student statewide test results are the foundation of a school-performance measurement structure that the United States has been painstakingly constructing in the decades since being declared “A Nation at Risk” in 1983. The information from the tests is used at every level of the system. It enables parents to see how their children are faring on an “external” metric, beyond the grades conferred by their teachers, and it helps principals assess how their schools are doing. The results also equip superintendents to gauge what must be done to boost district-wide achievement, and they furnish state officials with the information needed to guide their assistance and interventions.”

Today, nearly two decades after the states were mandated to administer annual standardized tests and after No Child Left Behind imposed sanctions on the schools with the lowest scores, we know that the whole scheme failed to support children’s school achievement and failed to close achievement gaps. Some schools were charterized as a punishment; other schools were shut down; principals and teachers were fired.  And scores on the national audit test, the National Assessment of Education Progress (the NAEP), have fallen in some cases and in other cases remained flat.

I believe it is unnecessary—in the midst of a raging pandemic and a Presidential transition—to worry about when the federal government will mandate widespread standardized testing.  The bigger question is whether and how the federal government will manage a plan to get the pandemic under control and provide enough support to help states and school districts get all children and adolescents back in school.

I agree with Diane Ravitch, who explains: “Resumption of standardized testing is completely ridiculous in the midst of a pandemic. The validity of the tests has always been an issue; their validity in the midst of a national crisis will be zero. They will show, even more starkly, that students who are in economically secure families have higher test scores than those who do not. They will show that children in poverty and children with disabilities have suffered disproportionately due to lack of schooling.  We already know that.  Why put pressure on students and teachers to demonstrate what we already know?  At this point, we don’t even know whether all students will have the advantage of in-person instruction by March.  If anything, we need a thorough review of the value, validity, and reliability of annual standardized testing, a practice that is unknown in any high-performing nation in the world.  We are choking on the rotten fumes of No Child Left Behind, Race to the Top, and the Every Student Succeeds Act.”

2013 NAEP Scores Show (Again) That Test-and-Punish Hasn’t Worked

Yesterday the  National Assessment of Education Progress (NAEP) scores from 2013 were released.  According to Education Week, eighth grade math scores rose by one point with a three point gain in reading.  Fourth graders gained a point in math with no significant change in reading.

The NAEP is a test given across the states every two years.  It is used neither to diagnose students’ specific learning needs nor to evaluate any specific child’s performance nor to evaluate teachers or specific schools.  Not all schools are tested and not all children who take the test are given the entire test.  It is administered across the country as an overall assessment of how America’s public schools are doing.

Diane Ravitch, who served for several years on the National Assessment Governing Board, explains the operation and significance of NAEP in her new book Reign of Error: “NAEP is central to any discussion of whether American students and the public schools they attend are doing well or badly. It has measured reading and math and other subjects over time.  It is administered to samples of students; no one knows who will take it, no one can prepare to take it, no one takes the whole test.  There are no stakes attached to NAEP; no student ever gets a test score.” (p. 45)  Ravitch explains that the NAEP has tested students every two years since 1992, with a long form that has been administered since the early 1970s.

For all groups of children—at all ethnic, racial, and economic levels—NAEP scores have been slowly and steadily climbing over time.  Achievement gaps by race and economics, however, have not narrowed; although black and brown and poor children have steadily improved their scores, so have white and Asian children.  According to the reports in yesterday’s press, the long term trend was not interrupted in the 2013 NAEP scores.  Education Week reports: “In 2013, 51 percent of Asian students and 46 percent of white students reached proficiency in 4th grade reading, compared with 20 percent of Hispanic students and 18 percent of black students…  Only one quarter of students eligible for free or reduced-price meals reached proficiency in 4th grade math, compared with 59 percent of their wealthier peers.”  Because the proficiency benchmark score is known to be set very high for the NAEP, the overall low numbers of reported proficiency should not frighten us. However, the persistent gaps by race, ethnicity and economic level are deeply troubling.

There are a couple of obvious facts that stand out. First, the No Child Left Behind Act with its test-and-punish philosophy, that tried to scare educators into working harder and smarter and doing more with less, has not succeeded in its goal of closing achievement gaps.  Neither have the huge national competitive grant programs of the Obama-Duncan Department of Education.  These experiments in test-based-accountability have not addressed the inequities that are closely tied to achievement gaps.

While we ought to be relieved that the mass of standardized testing our children face today has not entirely reversed past progress, we must face the reality that test-and-punish school reform has failed to address the needs of our society’s poorest children who continue to struggle.  According to Motoko Rich in the NY Times, the highest scoring states on this year’s NAEP include Massachusetts, Minnesota and New Jersey, states with lower proportions of children living in poverty.

Scores this year climbed fastest in Washington, D.C., but when Gary Rubenstein, a New York City math teacher and blogger, examined the numbers, he discovered that Washington, D.C.’s NAEP scores remain 64 points below the national average, lower than scores in any state.  His analysis demonstrates that the gap between students who qualify for free lunch and those who don’t qualify remains wider in Washington, D.C. than in any state: a shocking 157 points.