Chester Finn, president emeritus of the Thomas Fordham Foundation, Frederick Hess, head of education policy studies at the American Enterprise Institute, and Michael Petrilli, president of the Thomas Fordham Institute, have been arguing this summer about whether public school reform based on test-and-punish school accountability is dying. For decades, these three men have been central to defending the changes embedded into federal law by the 2002, No Child Left Behind Act (NCLB) and into state laws across the United States as Arne Duncan’s Department of Education made states comply with these educational theories to qualify for federal Race to the Top grants in 2009.
While these three proponents of accountability-based school reform disagree on where this movement stands today, they all agree on what it is. Petrilli remembers how he defined school reform back in 2006: “There is now a Washington Consensus in education. It has been entrenched since the middle of the Clinton Administration, was integral to the crafting of NCLB in 2001, and for the most part remains intact today. It embraces three big ideas. First, that the nation’s foremost education objective should be closing racial and economic achievement gaps. Second, that excellent schools can overcome the challenges of poverty. And third, that external pressure and tough accountability are critical components of helping school systems improve.”
Petrilli explains further how these ideas coalesced: “These ideas took shape as a series of federal mandates, most visibly enshrined in NCLB. States had to set academic standards in English language arts, math, and science; to test students annually in math and reading and regularly in science; and to create accountability systems that would not only report results, but also intervene in chronically low performing schools in very specific ways—the law’s ‘cascade of sanctions.’ Meanwhile, as NCLB was debated, enacted, and implemented, the charter school movement expanded rapidly….”
Finn and Hess add: “This early 21st-century focus on accountability and choice signified a pair of important shifts in Americans’ understanding of K-12 education. In the era before A Nation at Risk, people generally gauged school quality on the basis of inputs, resources, and reputation, not student-learning outcomes… Yet by the time Barack Obama entered the White House in 2009, a ‘good ‘ school had come to mean one with high reading and math scores… (and) the right of parents to select their child’s school was increasingly taken for granted.”
Finn and Hess trace a retreat from the heavy hand of the federal government as the 2015, Every Student Succeeds Act replaced No Child Left Behind. They believe the “school choice” strand of school reform is definitely thriving today, but the focus on test-and-punish school accountability has faded. Importantly they admit that this kind of school reform did not achieve its stated goal of closing achievement gaps as measured by test scores: “Did the movement do any good while it lasted? It certainly yielded unprecedented transparency regarding student achievement. It produced a massive expansion of charter schooling and parental choice. And it pushed educational outcomes to the center of the national conversation about opportunity and economic growth. Yet there’s scant evidence that it improved student outcomes, especially in the upper grades. Meanwhile, by enlisting Uncle Sam as the nation’s school superintendent, reformers helped entangle education fights with broader clashes over politics and culture. Along the way, they narrowed school curricula, dismissed the concerns of middle-class parents, and defined success using a race-centric notion of achievement gaps.”
Petrilli reaches a very different conclusion: “Let’s take a look at the real world shall we? The charter school sector continues to grow, energized by the lackluster response of traditional public schools to the pandemic. The Common Core standards remain in place in a majority of states, even if they go by different names. Annual testing is still here—with better, tougher tests than we had a decade ago. High-quality instructional materials aligned to the standards continue to gain market share. And that’s not to mention the explosion of private school choice (mostly supported by Republicans) or the progress on school funding equity (mostly supported by Democrats)…. Energizing grass-roots support for standards-based reforms would be fantastic….”
Finn and Hess are correct that the wave of support for technocratic school accountability has utterly faded from the national political conversation. But, while Petrilli’s allegation about a wave of high-quality instructional materials over the past two decades is highly questionable, and although there is abundant evidence that public school funding equity has not thrived under the “school reformers” agenda, I think MIke Petrilli has a point. Even while what he calls “the Washington Consensus” has faded, the consequences of test-and-punish school accountability are still very much with us. Our kids in public schools still have to be tested every year in grades 3-8 and once in high school, and the federal government still forces states to rate and rank public schools by their aggregate test scores.
The most profound long term impact of the whole school reform agenda is deeper, however, than Mike Petrilli acknowledges. The meaning of standardized test-based school accountability is best captured by rhetorician Robert Asen in recent book, School Choice and the Betrayal of Democracy. Asen believes that the school reformers significantly changed the way America thinks, imagines, and talks about public education: “In a bipartisan manner, accountability and standards functioned analogously to the roles of central banks and other regulatory market institutions in establishing common measures of educational value and exchange. Various actors, from state education officers to individual families, could participate in educational markets confident that they could exchange with others through commensurable means. Testing and test scores served as market valuations and currency. Individual schools, local districts, and states could market themselves to individual and institutional investors as sound opportunities. Test scores also provided market actors with the information they needed to make comparative choices among various education providers.” (School Choice and the Betrayal of Democracy, p. 81)
The era of test-and-punish set the stage for thinking of education as a consumer marketplace.
Cognitive linguist, George Lakoff would explain that the movement for school accountability based on standardized test scores changed the frame in which we conceptualize our public schools: “Frames are mental structures that shape the way we see the world. As a result, they shape the goals we seek, the plans we make, the way we act, and what counts as a good or a bad outcome of our actions. In politics our frames shape our social policies and the institutions we form to carry out our policies… You can’t see or hear frames. They are part of what cognitive scientists call the ‘cognitive unconscious’—structures in our brains that we cannot consciously access, but know by their consequences: the way we reason and what counts as common sense. We also know frames through language. All words are defined relative to conceptual frames… Reframing is changing the way the public sees the world. It is changing what counts as common sense.” (Don’t Think of an Elephant!, p. xv)
The most basic critique of accountability-based school reform—whose impact is currently being debated by some of its strongest adherents—Finn, Hess, and Petrilli—is that its frame is entirely quantitative. School accountability based solely on aggregate standardized test scores fails to measure the qualitative process of education as experienced by students and practiced by teachers. Here we can turn to the late Mike Rose, a professor of education and a discerning writer.
Rose considers students’ lived encounters with schooling: “I’m interested… in the experience of education when it’s done well with the student’s well-being in mind. The unfortunate thing is that there is nothing in the standard talk about schooling—and this has been true for decades—that leads us to consider how school is perceived by those who attend it. Yet it is our experience of an institution that determines our attitude toward it, affects what we do with it, the degree to which we integrate it into our lives, into our sense of who we are.” (Why School?, p. 34) “I’m especially interested in what opportunity feels like. Discussions of opportunity are often abstract—as in ideological debate—or conducted at a broad structural level—as in policy deliberation. But what is the experience of opportunity? Certainly one feels a sense of possibility, of hope. But it is hope made concrete, specific, hope embodied in tools, or practices, or sequences of things to do—pathways to a goal. And all this takes place with people who interact with you in ways that affirm your hope.” (Why School?, p. 14)
What about the school reformers’ quantitative attempts to measure and evaluate the quality of teachers? (Reminder: A central requirement for states to qualify for a Race to the Top grant was that states evaluate teachers based on their students’ aggregate standardized test scores.) In an important 2014 article, Rose challenged this technocratic frame based on his qualitative observations of teachers when he visited their classrooms: The “classrooms (of excellent teachers) were safe. They provided physical safety…. but there was also safety from insult and diminishment…. Intimately related to safety is respect…. Talking about safety and respect leads to a consideration of authority…. A teacher’s authority came not just with age or with the role, but from multiple sources—knowing the subject, appreciating students’ backgrounds, and providing a safe and respectful space. And even in traditionally run classrooms, authority was distributed…. These classrooms, then, were places of expectation and responsibility…. Overall the students I talked to, from primary-grade children to graduating seniors, had the sense that their teachers had their best interests at heart and their classrooms were good places to be.”
Although many of us, if asked, will qualitatively describe our own schooling or our children’s schooling from our values and personal experience, aren’t we still likely to cling to the frame of test-based accountability when we think broadly about American public education? As we read Mike Rose’s descriptions of what really matters in students’ experience and in the practices of their teachers, aren’t many of us tempted to wonder if his thinking isn’t old fashioned? Could most of us even conceptualize a society without quantitative evaluation and the ranking of schools and school districts even though we know that No Child Left Behind’s policies failed to equalize educational opportunity and leave no child behind? I wish I did not fear that, as a society, we are a long, long way from being able to reject the worn out school accountability frame brought to us by the likes of Checker Finn, Rick Hess, and Mike Petrilli.
9 thoughts on “How Has Standardized Test-Based School Accountability Changed the Way We Understand Public Schooling?”
This should be required reading for every educator (and prospective educator). Thank you.
Reblogged this on Random Thoughts, Sports and Stuff.
Reblogged this on Politicians Are Poody Heads.
technocratic despotism vs. humanistic empowerment
“It certainly yielded unprecedented transparency regarding student achievement. . . . The Common Core standards remain in place in a majority of states, even if they go by different names. Annual testing is still here—with better, tougher tests than we had a decade ago. . . . Various actors, from state education officers to individual families, could participate in educational markets confident that they could exchange with others through commensurable means. Testing and test scores served as market valuations and currency. Individual schools, local districts, and states could market themselves to individual and institutional investors as sound opportunities. Test scores also provided market actors with the information they needed to make comparative choices among various education providers.”
To which I respond:
In addition to that and perhaps even worse is that the proponents of these standards claim that the CCSS are standards against which ‘student achievement’ can be measured. In doing so educational standards proponents claim the documentary standard (definition three) as a metrological standard (definition four). In doing so they are falsely claiming a meaning of standard that should not be given credence1.
This confusion is compounded by what it means to measure something and the similar misuse of the meaning of the word measure by the proponents of the standards and testing regime. Assessment and evaluation perhaps can be used interchangeably but assessment and evaluation are not the same as measurement. Word usage matters!
The Merriam-Webster dictionary definition2 of measure includes the following:
1a (1): an adequate or due portion (2): a moderate degree; also: moderation, temperance (3): A fixed or suitable limit: bounds b: the dimensions, capacity or amount of something ascertained by measuring c: an estimate of whit is to be expected (as of a person or situation d: (1): a measured quantity (2): amount, degree
2a: an instrument or utensil for measuring b (1): a standard or unit of measurement—see weight table (2): A system of standard units of measure
3: the act or process of measuring
4a (1): melody, tune (2): dance; especially: a slow and stately dance b: rhythmic structure or movement: cadence: as (1): poetic rhythm measured by temporal quantity or accent; specifically: meter (2): musical time c (1): a grouping of a specified number of musical beats located between two consecutive vertical lines on a staff (2): a metrical unit: foot
5: an exact divisor of a number
6: a basis or standard of comparison <wealth is not a measure of happiness
7: a step planned or taken as a means to an end; specifically: a proposed legislative act
Measure as commonly used in educational standard and measurement discourse comes under definitions 1d, 2, and 3, the rest not being pertinent other than to be used as an obfuscating meaning to cover for the fact that, indeed, there is no true measuring against a standard whatsoever in the educational standards and standardized testing regimes and even in the grading of students. What we are left with in this bastardization of the English language is a bewildering befuddle of confusion that can only serve to deceive many into buying into intellectually bankrupt schemes that invalidly sort, rate and rank students resulting in blatant discrimination with some students rewarded and others punished by various means such as denying opportunities to advance, to not being able to take courses or enroll in desired programs of study.
The most misleading concept/term in education is "measuring student achievement" or "measuring student learning". The concept has been misleading educators into deluding themselves and others that the teaching and learning process can be analyzed/assessed using "scientific" methods which are actually pseudo-scientific at best and at worst a complete bastardization of rationo-logical thinking and language usage.
There never has been and never will be any "measuring" of the teaching and learning process and what each individual student learns in their schooling. There is and always has been assessing, evaluating, judging of what students learn but never a true "measuring" of it.
The TESTS MEASURE NOTHING, quite literally when you realize what is actually happening with them. Richard Phelps, a staunch standardized test proponent (he has written at least two books defending the standardized testing malpractices) in the introduction to “Correcting Fallacies About Educational and Psychological Testing” unwittingly lets the cat out of the bag with this statement:
“Physical tests, such as those conducted by engineers, can be standardized, of course, but in this volume, we focus on the measurement of latent (i.e., nonobservable) mental, and not physical, traits.”
Notice how he is trying to assert by proximity that educational standardized testing and the testing done by engineers are basically the same, in other words a “truly scientific endeavor”. The same by proximity is not a good rhetorical/debating technique.
Since there is no agreement on a standard unit of learning, there is no exemplar of that standard unit and there is no measuring device calibrated against said non-existent standard unit, how is it possible to “measure the nonobservable”?
PURE LOGICAL INSANITY!
Finally, what the proponents of the educational standards and standardized testing regime don't appear to understand is that in many areas of human interactions and feelings there cannot be any measurement. How does one measure the love of one's spouse, children, parents or friends? How does one measure what is going on in the heart and mind of a distressed person who has just lost a loved one? Why do we even begin to think that we can measure what goes on in the body and brain of the student who is learning any subject matter considering all the various hormonal and endocrinal influences occurring outside the individual's control, with the hundreds of millions if not billions of neuronal firings going on at any given moment that partially influence what happens in the mind of the student in a teaching and learning situation? How do we believe that the thousands and thousands of environmental influences on each individual could begin to be measured and accounted for? Are proponents of the educational standards and standardized testing "measurement" regime that arrogant, hubristic and presumptuous to believe that they hold the key to supposedly measuring the teaching and learning process or more specifically, the learning, aka, student achievement, of an individual student?
Considering the facts of the misuse of language, logic and common sense as outlined above, the only wise course of action is to immediately cease and desist, to abandon, those malpractices that harm so many students and contravene the state's responsibility in providing a public education for all students. The billions of dollars spent by states on the educational standards and standardize testing regime would then be freed up to provide a better education for all students through perhaps such things3 as smaller class sizes, needed social services, foreign language instruction, arts programs, etc. And the state, by approving and mandating the fake standards and false measuring of student learning that are the malpractices4 of educational standards and standardized testing, by not adhering to a regimen of fidelity to truth is surely guilty of not promoting "the welfare of the individual so that each person may savor the right to life, liberty, the pursuit of happiness, and the fruits of their own industry." (From Ch 6. "Of Standards and Measurement" in "Infidelity to Truth: Education Malpractice in American Public Education")
Thanks for the amazing post!
“Asen believes that the school reformers significantly changed the way America thinks, imagines, and talks about public education…” Where I live in suburban Denver, “school choice” has become the mantra for parents, solidifying the thought that choosing a school is a consumer right for parents, which leads naturally to the parent assumption of choice of what books students can read or cannot read, parent choice of what teacher will teach their child, etc. As the money follows the child according to parental choice, the parents naturally assume, wrongly, that the money belongs to them to choose how to spend it on education. Privately operated charters, vouchers, and backpacks full of cash lead me to believe that even as old as I am, I may yet live to see an educational system that I don’t even recognize any longer like the one I experienced in the 50s and 60s as a student, and the 70s, 80s, and 90s as an educator.
Pingback: Assessment Reform News: August 10 – 16, 2022 – Fairtest
Pingback: New Ohio School Report Cards Rate Schools on 5-Star System Instead of Letter Grades, But the Results Still Fail to Recognize What Schools Do | janresseger