How to Make Your Data Talk! Clara Ballantine, SIA Montreal
Transcription
How to Make Your Data Talk! Clara Ballantine, SIA Montreal
Montreal March 29, 2011 How to Make Your Data Talk! Clara Ballantine, SIA SHN Ontario www.saferhealthcarenow.ca “When you two have finished arguing your opinions, I actually have data!” www.saferhealthcarenow.ca Objectives In the next 15-20 Minutes we will: Review the concept of variation Use run charts effectively to understand what your data is telling you Use the Pareto Principle to focus your improvement work www.saferhealthcarenow.ca What Do We Need to Know? How much variation do we have? Is this process changing significantly over time? Have our changes resulted in improvement? Are we holding the improvement? www.saferhealthcarenow.ca What is Normal Variation? “Every process is perfectly designed to get the results it gets”. Don Berwick Normal variation is inherent in the existing process and is not related to a specific cause or event, but rather to how the process is designed. www.saferhealthcarenow.ca What is Special Cause Variation? Special cause variation is a change in our data in response to a specific, unusual event or impact on the process. How do we know the difference? www.saferhealthcarenow.ca Use a Run Chart • • • • A line graph of data plotted over time Data is kept in time order Can see flow of data Helps answer our improvement questions www.saferhealthcarenow.ca 'And this is the period when the cat was away. ' www.saferhealthcarenow.ca Why Use a Run Chart? Delay Times (Hrs) Before and After Test (Change Made Between Week 7 & Week 8) 10 9 8 7 6 5 4 3 2 1 0 8 3 Before Chance (measure point on week 4) After Change (measure point on Week 11) Case 1 Delay Time (Hrs) 12 10 Made Change 8 6 4 2 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 Weeks Provost, L and Murray, S. The Health Care Data Guide. Jossey Bass, 2011 www.saferhealthcarenow.ca Run Chart – Falls 4.0 Goal New staff started Team Leader resigned Staff Training complete 1MD, 1RN trained Baseline Thanks to: Virginia Flintoft SHN Central Measurement Team 10 www.saferhealthcarenow.ca Include the Median In a series of numbers, the median is physically the middle number . It has the same number of points equal to it or above it as it has equal to it or below it. www.saferhealthcarenow.ca % Timely Reperfusion Date 1/07 Data 32 2 23 3 32 4 38 5 35 6 35 7 40 8 21 9 38 10 26 11 22 12 1/08 2 27 23 32 3 36 4 29 5 38 65 42 7 8 39 36 9 50 10 11 48 39 12 44 Run Chart 60 Chg 4,5,6 55 50 Chg 7 Change 1 45 percent 40 Chg 8,9 35 Chg 2,3 Median 35 30 25 20 15 1/07 2 3 4 5 6 7 8 9 10 11 12 1/08 Months 2 3 4 5 65 7 8 9 10 11 12 www.saferhealthcarenow.ca Finding the Median: Reordering the Data 50 48 44 42 40 39 39 38 38 38 36 35 35 35 32 32 32 29 27 26 23 23 22 21 • To find the median reorder the numbers from high to low and find the number physically in the middle. If you have two numbers left in the middle, add them together and divide by two. • Excel: place cursor in blank cell and type=MEDIAN(A2:A21) where A2 is the first cell you want to include and A21 the last) www.saferhealthcarenow.ca Example Source: National Nursing Home Improvement Collaborative: Pressure Ulcer Prevention and Treatment Handbook, Qualis Health www.saferhealthcarenow.ca Rule 1 Six or more consecutive POINTS either all above or all below the median. Skip values on the median and continue counting points. Values on the median DO NOT make or break a shift. Measure or Characteristic Rule 1 25 20 15 10 5 Median 10 0 1 2 Median=11 Median=10 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 Ott, Ellis, Process Quality Control, McGraw-Hill Book Company, NY, 1975 ; Provost, L and Murray, S. The Health Care Data Guide. Jossey Bass, 2011 www.saferhealthcarenow.ca Rule 2 Five points all going up or all going down. If the value of two or more successive points is the same count the first one then ignore the identical points when counting; like values do not make or break a trend. Measure or Characteristic Rule 2 25 20 15 10 5 Median 11 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 Olmstead, Pl, “Distribution of Sample Arrangements for Runs Up and Down, Annals of Mathematical Statistics, Vol 17, pp. 24-33, March, 1945. Provost, L and Murray, S. The Health Care Data Guide. www.saferhealthcarenow.ca Jossey Bass, 2011 RULE 3 Measurement or Characteristic For detecting unusually large or small numbers: • Data that is Blatantly Obvious as a different value • Everyone studying the chart agrees that it is unusual • Remember: Every data set will have a high and a low - this does not mean the high or low are astronomical Rule 3 25 20 15 10 5 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Provost, L and Murray, S. The Health Care Data Guide. Jossey Bass, 2011 www.saferhealthcarenow.ca Checklist Process www.saferhealthcarenow.ca Use Small Multiples to Tell the Whole Story www.saferhealthcarenow.ca Tracking Checklist Impact Checklist spread to 4ORs All team in OR for checklist for all cases Checklist introduced Median 6.5 www.saferhealthcarenow.ca Key Points • Use a run chart to display your data over time • Include a Goal line and/or desired direction • Calculate and show a Median line to see trends • Analyze your data “by the rules” www.saferhealthcarenow.ca Key Points • Annotate your run chart – it tells your story • Annotation helps you see the impact of your tests of change and can help you decide to “adopt, adapt or abandon” a change. • Use Small Multiples to see how parts of the process contribute to the overall process performance www.saferhealthcarenow.ca Use Pareto Thinking to Focus Improvement Efforts Thanks to Leanne Couves and Tanis Rollefstad www.saferhealthcarenow.ca Key Points • Use Pareto thinking to understand what are the main contributors to the problem • Display your data on a Pareto Chart to help others understand where they can have the most impact • Focus on the “Vital Few” in your improvement efforts www.saferhealthcarenow.ca Translate Numbers into Human Impact VAP Rate per 1000 Vent Days Impact: 1 Life Saved per Quarter Thanks to Dr. Chris Hayes, St Michael’s Hospital, Toronto www.saferhealthcarenow.ca To boldly go where you have never gone before… www.saferhealthcarenow.ca For Help With Your Data and Measurement Questions Virginia Flintoft 416.946.8350 virginia.flintoft@utoronto.ca Clara Ballantine 613.736.9142 clara.ballantine@qhn.ca Alexandru Titeu 416.946.3103 shn.ea@utoronto.ca www.saferhealthcarenow.ca