Goal Setting Is Often An Act of Desperation: Part 1

Did Dr. Deming forbid setting goals? Dive into this discussion about healthy goal setting, learn why your process matters, and the four things you need to understand before you start on goals. This episode is the first in a 4-part series about goal setting.

TRANSCRIPT

0:00:02.2 Andrew Stotz: My name is Andrew Stotz and I'll be your host as we continue our journey into the teachings of Dr. W. Edwards Deming. Today I'm continuing my discussion with John Dues, who is part of the new generation of educators striving to apply Dr. Deming's principles to unleash student joy in learning. This is episode 21 and we're talking about goal setting through a Deming lens. John, take it away.

0:00:26.9 John Dues: Yeah, it's good to be back, Andrew. Yeah, 'tis the season for resolutions, I suppose, so I thought we could talk about organizational goal setting and sort of doing that through a Deming lens. And I was thinking about, at a recent district leadership team meeting, I put the following quote up on a slide. I said, "Goal setting is often an act of desperation." You got to watch people's faces when they see that. And to give some context, we're sort of updating our strategic plan at United Schools Network and my point in putting that on the slide as a part of strategic planning was to start a discussion on sort of what I think is healthy goal setting and how that's not typical to what I've seen across my career in schools, education organizations.

0:01:22.4 JD: And I wanted to provide a framework for the team so that anyone that's setting a goal as a part of the strategic planning process sort of had this sort of mindset as we're going through the goal setting process. I think that the typical reaction to that quote, at least in my experience, has been something like, "But I thought that goal setting was something that highly effective people or highly effective organizations do." And my basic argument is that I think that that's the intention, but it's rarely the case, whether that's individuals or organizations. And there's these, what I've come to sort of frame as four conditions that have to be met during the goal setting process. And without those, you kind of get fluff for a goal setting, probably more likely just completely disconnected from reality. I think... Yeah, go ahead.

0:02:22.5 AS: I just wanted to talk to everybody out there that's listening and viewing. I mean, I'm sure you're going through goal setting all the time and as we talk about, it's the beginning of the year right now, this is actually, we're recording this in mid-January of 2024. So it's like I've been working on what's our vision? What's our mission? What's our values? Where are we going? What is our goal? What is our long term goal? What is our short term goal? And I don't know about you guys, but for me, it gets a little confusing and round in circles sometimes and overwhelming, and then this whole idea about, that goal setting is often an act of desperation. It's like I've been working on this stuff for recently over the last week or so and then I just heard you say that and I was like, "Oh, I'm really interested to learn more." So let's go through those four conditions.

0:03:18.5 JD: Yeah, I'll get to those in a second. But I... So I'm not saying don't set goals necessarily. And people have that same reaction typically to that statement, but it's goal setting is often an act of desperation. So it's not the goal in and of themselves, but generally it's the process that you go about and the lack of sort of logic behind the goals that I'm talking about. And I know on these podcasts, many of my examples have sort of I've been banging on like State Department accountability systems and stuff like that. I'm going to continue to do that today but I think the same sort of errors happen at the school system level, at the individual school building level, at the individual teacher or principal level, it's just the stakes are higher when you're talking about states and countries, systems of education.

0:04:11.8 JD: But what I've seen is over the last two decades, certainly post-No Child Left Behind, what it seems like is that there's often these goals set and they're sort of, the targets are sort of chosen out of thin air. And then there's this whole accountability system built around those goals and then in the case of states, we then rate and rank school systems or schools based on how they perform in relation to those goals. And again, the same type of thing is happening at the school system level, at the school level but probably the state accountability systems is what most educators are familiar with when I'm talking about goals. And in Ohio, like a lot of states, we give state tests, we give them third through eighth grade.

0:04:58.5 JD: They take reading and math every year, third through eighth grade in Ohio and you have to hit this 80% benchmark in terms of the percent of kids that are proficient in your school to meet the state standard. So the first question is, why not 60%? Why not 95%? Why not 85%? Why not 82.5%? Just random, you know? And my hunch is, the first problem is that that benchmark for passage rates, if you asked 100 people at the State Department or 100 people working in public school systems in Ohio, I'm not sure if anybody could give you that answer, why 80%? So the first problem is that that target itself is chosen arbitrarily and without sort of a deep consideration. And so that's sort of where the fork initially comes...

0:05:58.3 AS: And I would say that if I look at that 80%, it's like below that and you would seem like you're really underachieving, and above that, it's like, let's be realistic here of what the system can produce.

0:06:11.6 JD: Well, it's a B, it's a B minus. You know, that's familiar, a C, you're not allowed to bring home a C, but a B is okay. So, I mean, my guess is, I don't know where that particular target came from, but my guess is it's something maybe not too far off from, "well, it's sort of a B minus" in the typical grading scale in the United States.

0:06:32.4 AS: Probably came just the way we just discussed it.

0:06:35.1 JD: I would not be entirely surprised. So a lot of the problem with goal setting and when I'm saying act of desperation, it has to do with that arbitrary nature of the goal in and of itself. And so what I've sort of told the team here is that let's put forth some conditions that came up, I mentioned four, that we should understand prior to ever setting a goal. So the first thing we want to understand is what I call the "capability of the system" under study. So in this case, we've talked about third grade reading because that's such an important time period in a student's life.

0:07:13.4 JD: The states, lots of states put a lot of emphasis on it. In Ohio, there's a third grade reading guarantee that exists in other states as well. So we'll kind of look at data in that realm. So the first one, what's the capability of that third grade reading system? The second condition is we have to understand the variation that that system produces. So what are the ups and downs in the data? What are the patterns in the data? So capability, variation is the second condition. The third condition is, is the system that we're studying, is the data stable? When we look at the patterns of the data over time, is there predictability to it?

0:08:01.8 JD: Is there stability to that data or is it all over the place? And then the third thing or sorry, the fourth thing we want is a logical answer to the question, "by what method?" So let's take sort of a deeper look at each of those four conditions, kind of unpack those a little bit. We'll use third grade reading state testing data. I have some data on a chart, but I'll share my screen in a second for those that are viewing the data. And then for those that are only listening, I'll sort of narrate what we're looking at so you'll still get some value out of the description. So you see my screen now?

0:08:42.5 AS: Yep.

0:08:43.3 JD: Okay, cool. So we've looked at these charts before in previous episodes. It's been a while. So this is what some people call a control chart. I call it a process behavior chart because it's literally a description, a visual description of a process unfolding over time.

0:09:01.7 AS: And maybe I'll just describe it. At the title it says, Ohio Third Grade Reading State Testing Proficiency Levels. On the y-axis is the percent proficiency ranging from, of course, zero to 100. And on the x-axis, we have seven school years going from the 2015 to 2016 school year all the way to 2022 to 2023 school year. And then most importantly, we have points, that's a blue line here, but the points that are showing the movement of third grade reading state proficiency levels year by year or school year by school year. Continue.

0:09:51.1 JD: Yep, that's right. That's a good description. So those blue dots are the percent of third graders that are proficient each testing year. And to give you some context, in Ohio about 125,000 third graders take that state reading test each year. One thing you'll notice is that there is no data for 2019-'20. That's because we give the test in the spring of a school year. So in the spring of 2020, schools were shut down due to the pandemic so there was no state test. So we missed one year of testing, but that's really not, that's not really pertinent to this discussion. So the other thing you'll see on here is the green line is the average of the data running through there.

0:10:38.4 JD: And those red lines that are on either side of the data are, some people call them control limits, I call them the lower and upper natural process limit. And they're based on a statistical calculation. They're not where I want the lines to be, they're where they are based on the data. And f