Closing Achievement Gaps Will Require Closing Opportunity Gaps Outside of School

Last week this blog highlighted Advocates for Children of New York’s new report documenting that more than 10 percent of the over one million students in the New York City Public Schools—101,000 students—are homeless. These students are living in shelters, doubled up with friends or relatives, or living in cars and parks. What are the academic challenges for these homeless children and other children living in families with minimum wage employment, unemployment, unstable housing, food insecurity and inadequate medical care?

Although federal law continues to require that states measure the quality of schools and school districts with standardized tests, all sorts of research documents that students’ standardized test scores are indicators of their life circumstances and not a good measure of the quality of their public schools. Students concentrated in poor cities or scattered in impoverished and remote rural areas are more likely to struggle academically no matter the quality of their public school.

Here are just two examples of this research.

In 2017, Katherine Michelmore of Syracuse University and Susan Dynarski of the University of Michigan studied data from Michigan to identify the role of economic disadvantage in achievement gaps as measured by test scores: “We use administrative data from Michigan to develop a… detailed measure of economic disadvantage… Children who spend all of their school years eligible for subsidized meals have the lowest scores, whereas those who are never eligible have the highest. In eighth grade, the score gap between these two groups is nearly a standard deviation.” “Sixty percent of Michigan’s eighth graders were eligible for subsidized lunch at least once during their time in public schools. But just a quarter of these children (14% of all eighth graders) were economically disadvantaged in every year between kindergarten and eighth grade… Ninety percent of the test score gap we observe in eighth grade between the persistently disadvantaged and the never disadvantaged is present by third grade.”

In How Schools Really Matter: Why Our Assumption about Schools and Inequality Is Mostly Wrong, Douglas Downey, a professor of sociology at The Ohio State University describes academic research showing that evaluating public schools based on standardized test scores is unfair to educators and misleading to the public: “It turns out that gaps in skills between advantaged and disadvantaged children are largely formed prior to kindergarten entry and then do not grow appreciably when children are in school.” (How Schools Really Matter, p. 9) “Much of the ‘action’ of inequality therefore occurs very early in life… In addition to the fact that achievement gaps are primarily formed in early childhood, there is another reason to believe that schools are not as responsible for inequality as many think. It turns out that when children are in school during the nine-month academic year, achievement gaps are rather stable. Indeed, sometimes we even observe that socioeconomic gaps grow more slowly during school periods than during summers.” (How Schools Really Matter, p. 28)

In the context of this research, Downey examines the six indicators the Ohio Department of Education uses to evaluate public schools when it releases annual report cards on school performance. Although the state has ceased branding public schools with “A-F” letter grades, Downey explains that the state of Ohio continues to ignore the role outside-of-school variables in students’ lives when it blames educators and schools for low aggregate test scores:

“The report card for schools is constructed from six indicators and not a single one of them gauges performance independent of the children’s nonschool environments. First is achievement, which is based on the percentage of students  who pass state tests… By far, the biggest determinant of whether a school produces high or low test scores is the income level of the students’ families it serves… Second is the extent to which a district closes achievement gaps among subgroups. But performance on this indicator can also be influenced by factors out of the school’s control… Third, schools are gauged by the degree to which the school improved at-risk K-3 readers… Of course, it is much easier to make progress on this indicator if serving children who go home each evening to reinforce the school goals. Fourth, schools are evaluated on their progress, an indicator based on how much growth students exhibit on math and reading tests. This kind of indicator is better than most at isolating how schools matter, but again, growth is easier in schools where students enjoy home environments that also promote learning… Fifth, the graduation rate constitutes a component of the district’s (rating)… but this is only a measure of school quality if the likelihood of a child’s on-time graduation has nothing to do with the stress they experience at home, the access they have to health care, or the quality of their neighborhood.  Finally districts are evaluated on whether their students are prepared for success.  This indicator gauges the percentage of students at a school viewed as ready to succeed after high school… and is determined by how well the students performed on the ACT or SAT and whether they earned a 3 or higher on at least one AP exam… These report cards ‘are designed to give parents, communities, educators, and policymakers information about the performance of districts and schools,’ but what they really do is mix important factors outside of school with what is going on inside the schools in unknown ways.” (How Schools Really Matter, pp. 115-116)

What these reports and many others demonstrate is that we cannot expect that no child will be left behind merely because Congress passes a law declaring that schools can make every American child post proficient test scores by 2014. No Child Left Behind’s (and now the Every Student Succeeds Act’s)  policies—which have branded schools unable quickly to raise aggregate test scores as “failing schools”— have unfairly targeted school districts located in poor communities. In 2017, the Harvard University testing expert, Daniel Koretz published The Testing Charade: Pretending to Make Schools Better in which he shows that ameliorating opportunity gaps in the lives of children is not something schools can accomplish by themselves.

Koretz explains: “One aspect of the great inequity of the American educational system is that disadvantaged kids tend to be clustered in the same schools. The causes are complex, but the result is simple: some schools have far lower average scores—and, particularly important in this system, more kids who aren’t ‘proficient’—than others. Therefore, if one requires that all students must hit the proficient target by a certain date, these low-scoring schools will face far more demanding targets for gains than other schools do. This was not an accidental byproduct of the notion that ‘all children can learn to a high level.’ It was a deliberate and prominent part of many of the test-based accountability reforms… Unfortunately… it seems that no one asked for evidence that these ambitious targets for gains were realistic. The specific targets were often an automatic consequence of where the Proficient standard was placed and the length of time schools were given to bring all students to that standard, which are both arbitrary.” (pp. 129-130) Koretz continues: “(T)his decision backfired. The result was, in many cases, unrealistic expectations that teachers simply couldn’t meet by any legitimate means.” (p. 134)

U.S. Secretary of Education Miguel Cardona’s First Big Test

Miguel Cardona’s confirmation hearing as President Biden’s nominee for U.S. Secretary of Education is scheduled for this morning at 10 AM in the U.S. Senate Education Committee.  Assuming Cardona is confirmed by the committee and subsequently on the floor of the U.S. Senate, his first big test as Education Secretary will be his decision about what to do about federally mandated high-stakes student testing in this COVID-19 school year.

A groundswell of opposition to student testing continues to grow. On Saturday, the Washington Post‘s Valerie Strauss reported that educators across the states are asking Cardona “to give states permission not to give students federally mandated standardized tests this spring.”  Last year Trump’s education secretary Betsy DeVos cancelled the testing right after schools shut down nationwide due to the onset of the coronavirus pandemic.

Earlier last week, Strauss reported: “This is the second straight year that states are asking for waivers… This week, the U.S. Education Department sent a letter to chief state school officers saying the February 1 deadline for seeking a waiver was being extended though it didn’t set a new deadline. It promised states that it would soon provide details on submitting waiver requests….” Strauss adds that New York and Michigan have already requested waivers from standardized testing this spring.

Last Tuesday, FairTest, the National Center for Fair and Open Testing, convened a virtual, national town hall where experts detailed some of the many problems this spring with the logistics, the validity and the uses of the standardized testing regime mandated by the Every Student Succeeds Act annually for all 3rd-8th graders and once for high school students.

Dr. Lisa Escarcega described logistical challenges and asked participants to consider who would benefit from testing this spring and who would be harmed. A member of the Colorado State Board of Education, Escarcega described the many calls from her constituents trying to figure out how to get enough computers back in school to use for test administration. She explained that school districts have regularly loaned out school computers to students who have lacked access during the pandemic to online learning being provided by their schools and added that educators were struggling with the idea of taking back—for testing purposes—the very computers which their students are using to connect with their teachers in online classes.

Other speakers, including Rep. Jamal Bowman (D-NY); Dr. Julian Vasquez Heilig, Dean of the College of Education at the University of Kentucky;  Dr. Jack Schneider, an education historian from the University of Massachusetts, Lowell and co-author of the new book, The Wolf at the Schoolhouse Door; and Dr. Lorrie Shepard a professor of research and evaluation methodology at of the University of Colorado, described the special challenges during this school year.

In a recent Education Week column, Dr. Shepard summarizes many of the critiques aired in the FairTest town hall: “One of the main arguments for testing this spring is to document the extent of learning loss, especially disproportionate losses affecting poor children and communities of color.  We are told those data would then be used to allocate additional resources to support students who have fallen the furthest behind. Indeed, massive investments are needed…. We already have enough evidence of COVID impacts to warrant federal investments.”

Shepard continues: “Testing advocates should also consider the technical difficulties of testing during a pandemic. Remote testing requires security protocols that would violate privacy laws in some states, and even with such protocols, remote and in-person test results could not be aggregated or compared as if they were equivalent. Bringing all students into schools for testing when some are still learning remotely is unfair. Consider, too, that the many students who are now absent from remote learning would likely be absent from testing, skewing results compared with previous years.”

Valerie Strauss reprinted a letter addressed to Dr. Cardona from 74 national, state and local organizations and more than 10,000 individuals demanding that, once confirmed as Secretary of Education, Dr. Cardona  would give states waivers, if the states submit requests, to cancel the testing in the current school year. Here is what the letter says: “It does not take a standardized assessment to know that for millions of America’s children, the burden of learning remotely, either full- or part-time, expands academic learning gaps between haves and have nots. Whenever children are able to return fully to their classrooms, every instructional moment should be dedicated to teaching, not to teasing out test score gaps that we already know exist. If the tests are given this spring, the scores will not be released until the fall of 2021 when students have different teachers and may even be enrolled in a different school. Scores will have little to no diagnostic values when they finally arrive. Simply put, a test is a measure, not a remedy. To believe that it is impossible for teachers to identify and address learning gaps without a standardized test is to have a breathtaking lack of faith in our nation’s teachers.”

Among the organizations signing the letter are the Network for Public Education, the Schott Foundation for Public Education, FairTest, the Alliance to Reclaim Our Schools, the Journey for Justice Alliance, In the Public Interest, the National Superintendents Roundtable, and Defending the Early Years.