Is Transformation Needed? Deming in Schools Case Study (Part 6)

In this episode, John and Andrew discuss what "transformation" means in education. John juxtaposes two reports, conducted a decade apart, that have influenced education for the last 40 years: A Nation at Risk and the Sandia Report.

TRANSCRIPT

0:00:02.3 Andrew Stotz: My name is Andrew Stotz, and I'll be your host as we continue our journey into the teachings of Dr. W. Edwards Deming. Today, I'm continuing my discussion with John Dues, who is part of the new generation of educators striving to apply Dr. Deming's principles to unleash student joy in learning. The topic for today is, Do we really need to transform our education system? [chuckle] John, take it away.

0:00:26.7 John Dues: Andrew, it's good to be back with you. Yeah, I thought... Sort of as a jumping off point from our other conversations, I remember, I think in our first conversation, you mentioned you graduated from high school, 1983 in Cleveland area, went to a solid...

0:00:44.9 AS: Hudson High.

0:00:45.2 JD: Hudson High, good traditional public school in Northeast Ohio. And your question was, if I went back to the high school 40 years later, would it look and sound the same, would it have gotten better? Would it have gotten worse? What's going on with our schools in United States, I think was the basic question, I think... When I answered you, I said two parts, there's the question about what most people probably focus on when you think about that question about Did a school get better? Did the test scores improve or decline over time? And then there was a secondary question of, Did the school transform along the lines of the Deming philosophy? And I think that those two questions would have different answers depending on which schools you're looking at, but I thought it would be interesting to sort of think about this question, Do we really need to transform our education system through the lens of a couple reports...

0:01:48.5 JD: Education reports, one that's well known in our world, one that's lesser known, that took a look at the... At least the test results question in the education sector, and then build from there this idea of whether or not we need to transform our schools. One thing, there's no shortage of calls to transform or some people would use the word reform our schools, and those two words probably in and of themselves, probably have different applications, but we'll use them interchangeably as we go through that question and attempt to maybe answer that over this episode and maybe a couple additional episodes.

0:02:36.7 AS: I find that fascinating as I observe education around the world from my own experience outside of the US, and I look at the US, and I think about the importance of education, the role of education. There's a part of education that you could say is kind of indoctrination in the way a country educates its youth to be a certain way or to understand things a certain way, so I didn't see that part of education when I was young, but now I see every country's got their indoctrination that they do within their school system, so I see it kind of broadly, but I'm just curious, really take us through what you'd like to explain about that.

0:03:20.4 JD: Yeah, I think the sort of start... I think there's this quote in The New Economics where Dr. Deming says that people are asking for better schools with no clear idea how to improve education, nor even how to define improvement in education, and I think if that's... And he's saying this roughly the same time that these reports are coming out, and if that's true, I think what happens is when reports come out about the state of our education sector, it's pretty easy to get pulled this way and that. When you don't have a clear picture in your mind for what schools should look like or how to improve schools, these reports have large impacts. And so the first report is well known. It came out about the same time you were graduating from high school, in 1983 in the first Reagan administration, called A Nation at Risk. It's pretty well known in the education sector, and it's had a lot of far-reaching impact in both time and place, where even today, 40 years later, we still... Some of the roots of the various reforms that we've undergone in our sector, it's still playing a role.

0:04:40.6 JD: The second report is, that I'll sort of juxtapose against The Nation at Risk is a report that came out about a decade later called the Sandia Report, and I think it's really interesting just to look at those two reports and the impact or lack of impact they've had over the last 30 or 40 years in the world of education. So I think I would start with, when A Nation at Risk came out, and it was commissioned by the Reagan Administration, the National Commission on Excellence in Education is the group that released the report and one of the leading statistics that's in the report is that the SAT, the college entrance exam that high school students take demonstrates a virtually unbroken decline from 1963 to 1980, where average verbal scores fell over 50 points, and average mathematic scores dropped nearly 40 points in that roughly 20 year time period. And there's these really memorable quotes that are clearly meant to awaken the public to the state of its schools that people still remember to this day, and I'll read one. It says, "We report to the American people that while we can take justifiable pride in what our schools and colleges have historically accomplished and contributed to the United States and the well-being of its people, the educational foundations of our society are presently being eroded by a rising tide of mediocrity that threatens our very future as a nation and a people."

0:06:24.0 JD: You couldn't get much more of wake up type people language, it's really, really interesting. Like I said, this report over the last four decades has been that foundation or bedrock for the various federal reforms that people are probably familiar with, starting with...

0:06:41.0 AS: And to put it into context, that's the kind of talk that was coming out of the Reagan administration, like government's not helping and government can be a problem and we need to pull ourselves up by our bootstraps and you need to take personal responsibility, so it's very... It makes sense that that type of language was coming out of the Reagan administration.

0:07:05.4 JD: Yeah, and I think... So this report is floating around, there's a convening of all the governors in the United States in about 1989, and some pretty strong federal education legislation starts getting put together, it starts with the first Bush and then it ends up being passed during Bill Clinton's years called Goals 2000. And has various goals around increasing graduation rates and test scores and things like that, and then that transitions to No Child Left Behind with many people are familiar with that. Came out in the early Bush years and had a lot of impact on schools when my career was first getting started down in Atlanta, but it was federal legislation, so it covered the entire country, and then it even played a role even into the Obama years when he released the Race to the Top legislation, and that was more of a competitive grant program federally that was lots of strings attached a lot of focus on test scores, a lot of focus on teacher evaluations and principal evaluations and using test scores in those evaluations.

0:08:21.3 JD: And so you can see this, I think, direct linkage between A Nation at Risk, to Goals 2000, to No Child Left Behind, to Race to the Top, and even to the stuff that you see at the federal level to this day. So when a report like this comes out, it's called A Nation at Risk, the thesis of the report is right in the title. A nation is at risk because of its education sector, and so it's like... Most people say, Well, we gotta do something about this. We need to take action. There's some serious implications. And so about a decade after this report comes out, the Department of Energy sort of commissions its own report. The point of this report, as you might expect, is the department of energy, they're actually looking to do some economic forecasting, so it's not directly about our schools, but they wanna take the same data set that The Nation at Risk authors looked at and analyze it.

0:09:32.3 JD: And interestingly, they entered this analysis thinking that they are going to verify the results from a Nation at Risk, but what actually happened is that on nearly every measure of achievement, the Sandia analysts found actually steady or slightly improving trends in the test data. So they were...

0:10:02.1 AS: And in the same test data or in new test data that was coming out?

0:10:04.7 JD: Same exact data. They actually didn't look just at test data, they were actually looking at graduation rates, dropout rate, college-going rates so on just about every one of those measures, it was either steadily improving or slightly improving. And so you go back to A Nation at Risk and you have this absolute decline in SAT scores from the early '60s to the early '80s, and the Sandia authors aren't disputing that, but they're looking at their analysis and they're saying, wait a second, this decline in average scores, actually doesn't mean that the high school students of the early '80s or early '90s, weren't as capable as their 1960s peers. And so then you start to think, Well, how could this be? It's really, really interesting. And what the Sandia report authors go on to say is that when they broke out the test scores and these other measures like I said, graduation rates and other things like that, they broke them out by race and socioeconomic status, class rank, gender, they found these steady or improving rates in all of these groups, and they chalked it up to this statistical phenomenon called Simpson's Paradox, and basically what