The 21st Century Principal

Do PISA (Program for International Student Assessment) scores really matter? One would think so, because every time the latest round of scores are revealed, there’s a barage of “Sputnik-like” declarations of educational doom and gloom within the United States, all reminscent of when the Soviets launched the first satelite into orbit. Just like it did then, each time these scores come out, the declarations of“educational third world country” status is declared anew. The United States’ future economically is seen a bleak, and tales of woe begin. But there are some really good questions to ask about PISA.
If the United States suddenly vaults into first place in the PISA rankings will our country suddenly experience full employment and economic prosperity for all?

Will American businesses suddenly find all those “mythical-but-can’t-find-qualified workers?

Do PISA rankings by country really mean anything?

I would say “No” to all these questions. The United States’ “weak” rankings in PISA scores tell us absolutely nothing helpful nor does it indicate all the gloom and doom that policymakers public policy wonks like Arne Duncan have claimed in recent years.

Having a number one ranking in PISA scores is not a ticket to the economic promise land. Nor does it mean that we should take up the short-sighted view that our education system’s purpose—from kindergarter to higher education— is to feed the “human capital” machine for corporations. Sure, we want out students to be employable, but making sure they score high on an international test won’t do that. That’s short-sighted thinking. Education should never be about preparing students for the factory sitting down the street; it should be about preparing students so that they can learn and adapt for jobs their entire lives. It is simply short-sighted to see education as worker-training program. We need to train our students to be able to learn for a lifetime, be creative, be critical thinkers, and adapt to whatever comes their way. The jobs down the street will probably move to another country in a few years any way.

Using PISA data, or any standardized test data such as SAT as a scare-tactic and propaganda tool is a moral problem. Those who do that, are like the barkers selling a special elixir guaranteed to fix what ails. They should have the same credibility as snake oil salesmen. It is simply policymakers pushing their own brand of reform with the cry of “wolf.” Sure, our schools can always improve. We can teach our students more effectively. But, this clarion call of doom and gloom every time a round of PISAscores or any standardized test scores needs to met with skepticism if not just ignored.

The country rankings indicated on the PISA international test scores should not be used like the current lineup in a NASCAR race to determine who's currently in the lead in the educational "Race to the Top" because these rankings by themselves tell us absolutely nothing. So when our Secretary of Education, Arne Duncan begins his tales of woe and gloom and doom, be sure he's just using these to promote his own agenda. Sadly, this has been the practice a many of politician in recent times. Much of what Duncan has used to support his reform agenda has been a combination of half truths and what I would call benders because they either simply the real data or they ignore or dismiss other data just because it doesn't fit his propaganda. Sadly, we as educators still are letting Duncan and the media say these things without response.

In a blog post entitled "Reading the PISA Tea Leaves: Who Is Responsible for Finland's Decline and the Asian Magic," education scholar Yong Zhao points to an important point about all those Asian countries stacked at the top of the ratings. He states,

"The recipe for East Asian success is actually not that magical. It includes all the elements that have been identified as the symptoms of the GERM (Global Education Reform Movement) by the great Finnish education scholar Pasi  Sahlberg: Competition, Standardization, Frequent Testing and Privatization. In East Asia high performing systems, these ingredients are more effectively combined and carried out to extreme to result in societies devoted to ensure youngsters become excellent test takers."

Zhao points out further than while many of the East Asian countries are at the top of these international test rankings, they are "not at all happy with the outcomes of their education systems." They are producing some great test-takers, but they are not producing students capable of creative, innovative and entrepreneurial thinking. So even if the rankings mean something, the question becomes, "Do we want a nation of good test-takers? Or, do we want students capable of innovative, creative, and entrepreneurial thinking?" Zhao points out that these systems designed to facilitate a "Race to the Top" of national rankings are not going to provide the kinds of students capable of tackling the many problems we face.

Today, I stumbled across the video below that provides a fairly good perspective on these PISA scores. Admittedly, the video is produced by the American Federation of Teachers which may give one pause to consider its content, it still does get many things right about the misappropriated use of these international scores that is so commonly done by current education policy leaders.

"There is no association between test scores and national success, and, contrary to one of the major beliefs driving US education policy for nearly a half a century, international test scores are nothing to be concerned about." Keith Baker, "Are International Tests Worth Anything?" Phi Delta Kappan October 2007

Do the PISA international test scores really mean anything? No, according to Keith Baker, who once worked as a researcher for the US Department of Education. Diane Ravitch quoted Baker in her post at the Washington Post, "Four Lessons on the New PISA Scores." Ravitch, who certainly knows more about the history of international test scores than Secretary Duncan, points out, if anything, these PISA scores show that "the billions invested in testing, test prep, and accountability" have not done anything to raise our international test score standings. Duncan's mythical connection between international test scores and economic success is a tired one, and as Baker points out in his article, "Are International Tests Worth Anything?" it is wrong.

Besides, it appears that this data isn't all it is cracked up to be. David Stout at Time magazine points out in "China Is Cheating the World Student Rankings,"  that the Chinese, unlike the United States and other countries did not release all their scores. They only released the scores for ShangHai. As Stout points out, Hong Kong does not count for the Chinese, because they send in their own data because of their level of independence from China. Naturally, policymakers and media pundits interpret the scores as representing all of China when they only represent a portion. Makes one wonder what other games other countries are playing to manipulate the scores.

This illustrates a BIG problem with this international score carnival. There's no way to be sure that we're comparing apples to apples as they say, so these comparisons are meaningless. These rankings are worthless because they tell us absolutely nothing about the state and conditions of our schools. They only serve as a political talking point for a Department of Education still pushing a failed standards-testing-accountability policy that's failing because it does not address the real issues in our schools. And, if you disagree with them, then you're defending the status quo. I hate to break the news to them, but methinks they're actually perpetuating the status quo. It's really sad that Arne Duncan and his Department of Education would use these scores for propaganda purposes to continue to push his failing education agenda, but he's living up to his true calling: he's a politician, not an educator.

Yesterday, the media continued the tradition of sounding the alarm: "Our schools are doomed according to the latest PISA, or Program for International Assessment, scores." NPR chimes in with this one, "PISA Test Results for US Students Are Sobering," and Huffington Post has this headline, "US Test Scores Remain Stagnant While Other Countries See Rapid Rise." NBC news echoed Huffington Post with this one, "US Teens Lag in Global Education Rankings as Asian Countries Rise to the Top,"  One has to question when this incessant obsession with international test scores is going to stop. Why all this fuss about being first in test scores? Do they really think that somehow, magically, our nation will be transformed and educated when we suddenly move up the rankings?

Then there's Education Secretary Arne Duncan who is "Crying-Wolf" once more, when he says, "We're seeing a Picture of Educational Stagnation" as he pointed out at Townhall.com. About the only thing stagnant is his incessant droning about these test scores every time they come out.  Duncan hasn't learned the old wisdom that says "If you cry wolf too many times, people stop listening to you." Perhaps its time we do just that. He, no doubt, will use these scores as an opportunity to push his educational agenda of National Standards, National Testing, and tying teacher evaluations to test scores. His playbook of propaganda has become all too transparent over the past several years.

The truth is out there though. As Diane Ravitch pointed out in her new book Reign of Error, and as she points out in this Washington Post op-ed, "The myth persists that once our nation led the world on international tests, but we have fallen from that exalted position in recent years. Wrong, wrong, wrong." Ravitch points out that "THE UNITED STATES HAS NEVER BEEN FIRST IN THE WORLD, NOR EVEN NEAR THE TOP, ON INTERNATIONAL TESTS."

So why this continued obsession with being first? We have never been first since international assessments were first given in the 1960s or 1970s. Does that mean we haven't ever been economically competitive since? I think the history of business and industry shows that the economy did well during various times even when our international test scores were in the tank. The fact is, OUR ECONOMIC VIABILITY IS NOT TIED TO TEST SCORES and I would add, being first on international assessments isn't going to change our economic fortunes.

Perhaps it's time we, as educators, stopped accepting this mythology perpetuated by Arne Duncan and his Department of Education. It's time for us to demand that the media quit participating in this absurd obsession with test scores and comparing our students' performance with other countries, when we know that other countries game the system and test only more selective students.

Arne Duncan has not yet learned that apples do not compare to oranges, except perhaps in the narrow world he lives in. Educators at all levels need to start countering and questioning this Duncanesque perversion of the truth, and quit buying-in to the false mythologies his department of education is perpetuating. Sure, our schools sometimes struggle. We who are in the schools fight to reach students every single day. We teach our hearts out, and we have Duncan's Doom and Gloom constantly bellowing from Washington.

As far as I am concerned, he has "Cried Wolf" for the last time. He has nothing else left to say worthwhile. So I am no longer listening to him. I can't remove him from the Department of Education, but I can choose to stop listening to his blather. The sooner the Obama administration moves on and Duncan moves out, we can hopefully stop chasing myths and get down to the real business of improving education.

The truth is we are not going to test our way to economic prosperity, so it's time to realize that.