Frame the Challenge: Path for Improvement (Part 3)

John Dues and Andrew Stotz are diving deeper into the improvement model that John is building with his team. In this episode, learn the three ways to think about an improvement frame for your big challenge. 

TRANSCRIPT

0:00:02.6 Andrew Stotz: My name is Andrew Stotz and I'll be your host as we dive deeper into the teachings of Dr. W. Edwards Deming. Today I'm continuing my discussion with John Dues, who is part of the new generation of educators striving to apply Dr. Deming's principles to unleash student joy in learning. And the topic for today is Frame the Challenge. John, take it away.

0:00:23.6 John Dues: Hey Andrew, it's good to be back. Yeah, we're gonna talk about Framing the Challenge today. We kicked off a new series a couple of episodes ago. I introduced this improvement model that we can use to set ambitious goals backed with this sound methodology. Make this disclaimer again, we're sort of building the plane while we are flying it. So this improvement model is new at United Schools where I work. And so again, we're actually letting listeners sort of see it as it's being built and first put to use. And so I think just starting out with a quick recap of the model is a good place to start. So what is this improvement model that we've been looking at? I'll pull up my screen so we can share a visual of the model for those that are watching. Right. Can you see that all right?

0:01:21.2 AS: Yep.

0:01:21.3 JD: Great. Give me one second. All right. So we have this improvement model. Basically the core idea of the model is it gives us the scientific way of thinking. And remember, we talked about we're working to close this gap between current conditions in our organizations and future aspirations. In order to close this gap, we're walking through the four steps on the model. So first, we set the challenge of direction. That's really where we focused our time last episode. The second step is to grasp the current condition. The third step is to establish the next target condition. And then the fourth step is to experiment to overcome obstacles. And that's where we spend most of our time in this four-step process. And then the other thing we've talked about is we do it with this team. The people working in the system, that's one part of the system, one part of the team.

0:02:19.8 JD: And we've talked about this in our case. This can be students, it can be teachers, whoever the frontline people are in your organization. Then there's those with the authority to work on the system, to make changes to the design or the architecture of the system. That could be a teacher in a classroom, or we've said the principal of a school, or maybe the superintendent of a system of schools. And then one of the innovations that we've made to this improvement model is that that third group or that third person on the team is someone that has Profound Knowledge, someone that's using Deming's principles to guide the work. So that's the basic model that we looked at in the first episode and...

0:03:11.8 AS: And I would just highlight... By the way, can you put it on slideshow?

0:03:15.3 JD: Sure.

0:03:15.4 AS: And I've been reading Mike Rother's book, rereading his book on Toyota Kata and stuff. And so this has really got me back to it. But what you're doing is applying this and helping us understand it as you're putting it into action at your school, right?

0:03:35.0 JD: Yeah, we've had an improvement model. And I think... Yeah, so like it says down in the right hand corner, that this model, it's based on Mike Rother's work, the Toyota Kata work. I think one thing that was missing from our model previously was like, how do you set this challenge or direction? How do you do that in an ambitious but reasonable way? And I think Mike Rother's sort of model speaks to this. So that's why I like his four-step model. I also like the four steps because it's pretty simple. It's not 15 steps. It's not 20 steps. It's four steps. Now there are some steps that you have to learn and stuff like that. There are different pieces to each of the steps, but I like that it's four steps. It's sort of easy to remember. It's memorable. And I think the innovation that we've done so far is who is the team that's working through this? And I think to frame it as the people working in the system, the people working on the system, and then someone with Profound Knowledge, I think that's an innovation, from what I've read about Mike Rother's work.

0:04:39.6 AS: Yep.

0:04:40.4 JD: Yeah. And so to continue the recap from last time, I think in the last episode, so we introduced the model two episodes ago. And then last episode, what we said we were gonna do is start walking through each of the steps, episode by episode, and do a deeper dive into each of the steps. And we did that with step one last time. So we did Set the Challenge last time. And just as a refresher, this is that longer range goal that would differentiate us from other schools in our case, if we achieve it. But remember, we also said it seems nearly impossible at the outset. This is something that's off in the horizon. It's probably gonna take at least six months, probably more like two or three years. And then I gave this example at United where I am. So we're a school system. One of the challenges that we've set is to reduce our chronic absenteeism from 52%. So that's sort of the current condition. And we wanna bring that down to 5%. And there's this huge gap between those things. Obviously, we talked about an order of magnitude, and we don't quite know how to get there right now.

0:05:48.7 AS: Yeah, I think that's the point is we don't know how to get there right now.

0:05:57.6 JD: Yeah. Yeah. And I think... And so what I originally had planned to do is to go on to step two. And I think we're gonna do that next. But I wanted to pause because last time we briefly touched on this idea of Framing the Challenge as an improvement goal. And so with this episode, what I wanna do first before we go on to step two is talk about how to sort of think about that framing. And I sort of have studied a little bit of performance management from healthcare specifically. And there's really these three phases of performance management. When you're setting a goal, there's sort of performance measurement that has a research orientation. There's performance measurement that has an accountability orientation. And there's performance management that has an improvement orientation. And I think it's really important to understand the difference between those three types of measurement because I think conflation of those three things can derail and often derail improvement efforts. And in fact, as I was doing some research for this episode, I read this quote in one of the journal articles that I was sort of reviewing. It said, "the problem with measurement is that it can be a loaded gun, dangerous if misused, and at least threatening if pointed in the wrong direction."

[laughter]

0:07:19.6 JD: Right. So, when I read that I was like, this is important enough to take a pause and do a little bit deeper dive into that, you know, the differences between the three that we sort of got into on a surface level last time.

0:07:33.5 AS: One of the things that I like to say these days when I talk to people about measurement is measurement... If the subject being measured, let's say a table, I'm gonna measure the length of a table versus measuring the performance of an individual as an example. If the subject being measured knows, is aware that they're being measured, you're gonna have a problem.

0:08:02.0 JD: Yeah, I think that's very well put. And...

0:08:07.5 AS: The table doesn't care.

0:08:09.3 JD: The table doesn't care, but people always do. No doubt. No doubt. So I thought it'd be... I put together a table for those that are watching 'cause there is a lot of nuance to this and we'll kind of walk through this step by step, sort of the differences between goals or measurement for research, measurement for accountability, and then measurement for improvement. So I think just... I came up with these dimensions in some of the research I was doing. So, what's the purpose of each of those? What questions are you trying to answer? What are some example questions that are answered with that type of measurement? What's actually getting measured? How often is it getting measured? And then why does quality improvement or quality measurement matter in that particular area? So let's start with the purpose first. So when we're thinking about measurement for research, what we're really trying to do is contribute to some knowledge base, right?

0:09:01.8 JD: You know, I think the classic example is, what a university professor is often doing in their research. The second type of measurement is measurement for accountability. And really there, what we talked about last time is the purpose is to determine the application of rewards and sanctions or rewards and punishments. And that's really juxtaposed against measurement for improvement, which is... The purpose there is to learn our way to a system that produces a higher level of performance, right? And so let's look at measurement for research. We talked about the purpose being contributing to the knowledge base. If the questions that we're asking are about constructs or relationships between constructs or theories, then research is probably the direction we wanna go. An example question would be what's the relationship between two conceptual variables and what gets measured is... Could be numerous latent variables, but how often is this measurement happening? Typically once or twice during a study. And what we're trying to do is detect a relationship where they exist, right?

0:10:16.8 AS: So it could be... Like in a school, it could be a relationship betw