Powerful Learning with PDSA: Path for Improvement Part 8

It's time for PDSA (Plan-Do-Study-Act) Cycle 2 in John Dues' journey to reduce chronic absenteeism in his schools. His team is using PDSA to quickly test ideas and learn on a small scale. Find out what happened and how PDSA can be a powerful tool for learning.

TRANSCRIPT

0:00:02.2 Andrew Stotz: My name is Andrew Stotz, and I'll be your host as we dive deeper into the teachings of Dr. W. Edwards Deming. Today, I'm continuing my discussion with John Dues, who is part of a new generation of educators striving to apply Dr. Deming's principles to unleash student joy in learning. The topic for today is Powerful Learning with the PDSA Cycle, Part 2. John, take it away.

0:00:26.7 John Dues: It's good to be back, Andrew. Yeah, like you said, we, I think for the past three episodes or so, we've been working towards getting a better definition of our problem specific to this chronic absenteeism issue that we're working on this year. I don't know if you remember from last episode, but we have this team working and they've basically said we don't have enough information quite yet to write this precise problem statement. So we decided to gather information running the Plan-Do-Study-Act cycle. And last time we focused on the first cycle. This episode, we're gonna focus on a subsequent PDSA cycle, sort of along those same lines. For folks that are watching and perhaps just joining for the first time, I'll kind of share my screen and do a little bit of a review so that everybody can see or know what we're talking about, even if they're just listening for the first time. So we've talked about this improvement model. We're working through this four step improvement model. So set the direction or challenge is the first step. Grasp the current condition is the second step. Third step is establish your next target condition and then fourth, experiment to overcome obstacles.

0:01:44.3 John Dues: And we're doing all this with a team, people working in the system. People have the authority to work on the system and someone with the System of Profound Knowledge knowledge. right. And so, you know, we've talked about setting that challenge or direction. And as we're grasping the current condition, we've actually decided to skip to step four and experiment a little bit so we can get a deeper understanding of this problem that we've been working on. And you'll remember probably as well, did the screen change for you so you can see the chart now?

0:02:21.8 Andrew Stotz: Yeah.

0:02:22.9 John Dues: Yeah. Great. So I thought it'd be helpful to show this again too. So this is our process behavior chart of the chronic absenteeism rates dating back to the 2016/'17 school year. So we have eight years of data in regards to this problem. And you'll remember when we talked about set the direction or the challenge, we wanna basically cut this chronic absenteeism rate we're seeing coming out of the pandemic by a lot. So we're hovering around this 50% chronic absenteeism rate. We wanna cut it to 5%. So that means, you know, 50% or more of our kids, or right around 50% of our kids are missing 10% or more of the school year.

0:03:06.2 John Dues: And this is a trend that we're seeing all over the United States right now. And the other thing that we talked about is when we looked at this process behavior chart, that it's basically like there's a pre-pandemic system of chronic absenteeism, and then there's a post-pandemic system of chronic absenteeism. So, you know, before the pandemic, the rates were too high, but nowhere near to where they are now. So, you know, prior to the pandemic, we were sort of hovering around the, you know, 20 to 30% of kids chronically absent. And then, you know, coming out of the pandemic, it's been more like that, that 50% number that we've, that we've talked about.

0:03:49.4 Andrew Stotz: And so to reiterate for the listeners or the viewers, this is the chronic absentee rate at your school, as opposed to nationwide, which I remember last time you talked about, it's about 30% nationwide, and pre-pandemic, it was about 16%.

0:04:06.5 John Dues: Yeah. Right around there. So, yeah, so I'm talking about the four schools that make up our school system in Columbus, Ohio.

0:04:15.8 Andrew Stotz: Yep.

0:04:16.6 John Dues: And, you know, we have a pretty high percent of our kids are economically disadvantaged. And so the rates in schools that have that demographic tend to be more like ours, in that 40, 50% range. And then, but all schools coming out of the pandemic had much higher rates than what they had pre pandemic. No matter your affluence levels. It's just, just like a lot of things the schools with the most kids living in poverty get hit the hardest when you have these problems, basically. So, yeah, yeah. So what we were, we were studying this problem, and, you know, we have some idea of what's causing our challenges, but we've started running these PDSA cycles to dig into that a little bit more, and I'll, I'll, I'll stop sharing. So that's not distracting. And so we ran this first PDSA cycle we talked about last time, and now we're running, or we've just gotten finished running a second PDSA cycle. So for folks that are new to that, what that means is that we are basically running an experiment to test an idea, an idea about how to improve chronic absenteeism.

0:05:26.6 John Dues: And to do that we plan the intervention, then we do or run the experiment, we study it and then we act on that information. 'Cause that's where the PDSA comes from. So basically the objective specific to PDSA 2 is were or we designed a individualized intervention based on responses we get from interviews with kids using this five whys sort of empathy interview template. Right? And then after we do that, what's happening is that students are actually. So after the five whys is completed with the student, we move right into creating the plan of the PDSA still with that student. So they're part of the process. So that's also sort of a key, I think innovation of this particular round of PDSAs is the student is sitting there as we design the intervention. A student that has some issues with chronic absenteeism. And then basically in this particular plan, we decided we're gonna collect detailed attendance data for two weeks to evaluate the effectiveness of that.

0:06:39.7 Andrew Stotz: When you said this one, are you talking about the PDSA one or two?

0:06:43.5 John Dues: Two. The one. The one you just got done running. The one we're talking about. So the PDSA 2 ran for two weeks. So when I say experiment, I'm not talking about, you know, like a randomized controlled trial that can last a year or two years or five years before you get the results. I'm talking about something you can do in a day, a week, two weeks. My general rule is not to go over a month with these PDSA cycles. It starts to feel like it's too long. I wanna get data back quicker than that on an intervention. And so that's what we did with this PDSA cycle 2. And it was really, the plan was built around this key question. The key question was, will involving students in the design of an individualized intervention to address their chronic absenteeism lead to an increase in their average daily attendance rate during that period of intervention. So we're not taking that for granted just because we're sitting with the kids creating a plan with them. We don't know, we don't know what's gonna happen exactly. And basically step one of that plan was this five wise interviews that I talked about.

0:07:50.2 John Dues: So basically we had four staff members. So each one was assigned a student at their campus that they chose to work with on this initial intervention. And they took a piece of sticky paper and up top they basically wrote, here's our problem, the student's name. So let's say James is not coming to school consistently. And when students miss a lot of school, they're at risk of falling behind academically. And right below that problem statement, then they wrote, why are you not coming to school consistently? 'Cause that's the first why question. So that's sort of the first part of this five whys interview. So it's very simple. You need chart, paper and marker in about 20 minutes to do this. Step two is, then they used the information that they gathered from that five whys interview to design the intervention with the student. And basically what they did was they designed the intervention around the root cause that they got to at the bottom of that five whys sequence. So basically, you know, when they said that, when they asked that first question, you know, why are you not coming to school consistently? The student is then going to say something, right? I miss the bus almost every day.

0:09:10.7 John Dues: And so the next question, the next why question is built on the previous answer from the student. So why do you miss the bus every day? And you kind of keep going. And it doesn't always happen perfectly. Sometimes it takes three questions, sometimes it takes a little more than five. But generally speaking, once you drill down with those five whys, you'll get to sort of a root cause from the interviewee, right? And so then they're basically saying like, you know, based on that root cause we identified, what do you think we can do to improve your daily attendance? And then now they're sort of transitioning from the five whys into the planning of the intervention. And sort of that was step two of the plan. And step three is then actually starting to track the student's daily attendance as they do whatever that plan is across the 10 school days that are in that particular cycle. So that's the plan phase. You know, we had a key question that we designed around, and then the team also makes predictions about what they think is gonna happen during that cycle. That's the plan.

0:10:23.5 John Du