The Iarcca Outcome Measures Project
Transcription
The Iarcca Outcome Measures Project
The Iarcca Outcome Measures Project Executive Summary Report for Calendar Year 2005 and Cross-Year Comparisons IARCCA . . . An Association of Children and Family Services 5519 East 82nd Street, Suite A, Indianapolis, IN 46250 Phone (317) 849-8497 Fax (317) 576-5498 Email IARCCA@aol.com www.iarcca.org THE IARCCA OUTCOME MEASURES PROJECT Executive Summary Report for Calendar Year 2005 And Cross-Year Comparisons Jacqueline Remondet Wall, Ph.D. Steven M. Koch, Ph.D. IARCCA… An Association of Children and Family Services 5519 East 82nd Street, Suite A, Indianapolis, IN 46250 Phone (317) 849-8497 Fax (317) 576-5498 Email: IARCCA@aol.com www.iarcca.org Published July 28, 2006, Copyright © 2006, IARCCA . . . An Association of Children and Family Services. We encourage you to share the Annual Report with others. Permission to copy, disseminate and otherwise use this document or parts of it is granted as long as appropriate acknowledgement is given. Introduction What is the IARCCA Outcome Measures Project? The primary aim of the IARCCA Outcome Measures Project (referred to as the Project) is to evaluate the effectiveness of programs provided to children and families. The Project, conceived in 1995 and initiated on a state-wide scale in 1998, has collected information on youth receiving treatment from participating IARCCA member agencies. In 2005, 62 agencies participated in the Project (representing 68.1% of IARCCA member agencies). Since 1998, the average number of agencies participating in the project has been 67, with a range from 62 (in 2005) to 75 (in 1999). The total number of data packets1 submitted in 2005 was 11,886 (See figure below). When compared to 1998, this number represents a 43.1% increase in number of packets submitted. The total number of packets across the eight years of data collection is 81,237. The average number of data packets annually submitted by each agency has risen from 112 per agency in 1998 to 192 per agency in 2005. This represents an increase of 58.3% for packets completed by each agency. Total Number of Data Packets Submitted for the Project by Year 12,000 10,000 8,000 6,000 4,000 2,000 0 1998 1 1999 2000 2001 2002 2003 2004 2005 A packet is defined as the set of forms submitted for a youth at one of the three data collection times for the Project – at Intake, Discharge, or Follow-Up. Thus, the Child Risk Factor Survey, Child Problem Checklist, Family Problem Checklist, and the Intake Summary Sheet would constitute one packet. 1 Introduction Program Types Included in the Project Transitional Living Day Treatment Home-Based Foster Care Shelter Care Residential Programs Utilizing Public Schools Residential Programs Utilizing Both Public and On-Grounds Schools Residential Locked & Staff Secure Facilities Crisis Stabilization Outcome Measures A list of outcome measures for the Project is contained in the Appendix to this report, and includes measures of clinical, functional and placement outcomes. Additional information is collected related to risk factors, services provided during placement and consumer satisfaction. Member agencies provide a packet of data on children and families at: 1) Intake; 2) Discharge; and 3) Follow-Up (i.e., at 3 or 6 months after discharge, depending on the program). What Should One Know to Understand the Results? This report presents summary tables and highlights that describe selected characteristics of youth in each program, summary outcome data for each program collected at discharge and follow-up, and highlights of functional and placement outcomes, both from 2005 and for the last eight years of data collection. Outcome information has not been collected for all programs across all years. Therefore, some programs may have selected outcome information reported for a shorter time frame. The children and families served by any program are likely different from those served by the other programs. Some of these differences are reflected in the problem(s) presented at intake and the associated level of problem severity. There may also be important differences among the children and families served across the programs that the Project does not measure that impact program outcomes. The data is collected on those youth who enter programs, are discharged from placement, and are contacted for follow-up during each calendar year. For this Executive Summary and Annual Report, no efforts have been made to follow individual children from intake through discharge and follow-up. Therefore, no comparisons can be made about whether individual children made progress during their placement. Other investigations have been performed that examine how changes occur at the individual-level, and are available from IARCCA in a series of Special Reports, published by the IARCCA Institute for Excellence, Inc. Information presented in this Executive Summary focuses on functional and placement outcomes. It is not designed to comprehensively report on all outcomes, which are provided in the Annual Report. The interested reader should contact IARCCA for the Annual Report for 2005 or for information on the Project. 2 Characteristics of Youth Served in 2005 Youth Entering Care in 2005 Highlights The average age across all programs is 12.4 years, with a range from under 1 to 20 years of age. Children in the Foster Care program are significantly younger than youth in other program types (M2 = 8.05 years). Youth in the Transitional Living program, on the other hand, are significantly older than those in other programs (M=16.8 years). Just over two-thirds of youth are Caucasian (68.3%). More than 2 in 10 youth are African American (21.7%), just over three percent (3.4%) are Latino/Hispanic, and over six percent (6.6%) are of other ethnicities or are identified as multiracial. The average number of prior out-of-home placements is 2.1, with a range from 0 to 35 previous placements. Over 1 in 3 youth have a history of neglect (36.2%), about one-fourth have been physically abused (24.9%) and almost 1 in 5 have been sexually abused (18.8%). Almost half have parents who abused substances (46.1%), over one-third have a parent in jail (34.3%), and almost 1 in 5 youth have experienced the termination of parental rights (18.3%). Termination of parental rights across the years of the Project is shown below. A notable increase in loss of rights has occurred for youth in Shelter Care programs across the last year. Across the last eight years, increases are identified for Residential Care, and Transitional Living programs. Cross-Year Comparison of Termination of Parental Rights 1999-2005 Residential Care 40% Foster Care Transitional Living Shelter Care Hom e-Based 30% Day Treatm ent Crisis Stabilization 20% 10% 0% 1999 2 2000 2001 2002 M = Mean, or arithmetic average. 3 2003 2004 2005 4 Transitional Living 242 16.8 38.8 61.2 61.6 25.2 3.3 9.9 4.0 31.0 5.4 8.3 66.1 28.5 46.7 33.9 29.3 45.0 20.2 16.9 39.7 62.4 45.9 26.9 72.3 31.8 9.6 21.8 0.4 6.0 All Programs 5,319 12.4 53.8 46.2 68.3 21.7 3.4 6.6 2.1 26.7 1.0 1.5 48.1 31.4 36.2 24.9 18.8 30.5 14.5 27.1 37.0 46.1 34.3 17.8 55.5 18.3 6.5 11.4 0.4 4.5 58.5 28.1 4.7 8.8 1.0 16.9 0.6 1.2 14.5 48.3 9.3 11.6 5.2 14.0 21.5 40.7 32.6 29.7 25.0 8.7 58.7 15.2 7.3 7.9 0.0 3.4 70.9 29.1 172 13.8 Day Treatment 88.6 5.8 1.6 4.0 0.8 24.8 1.3 1.4 23.6 32.8 27.3 14.6 11.3 29.8 16.8 17.5 18.8 46.1 44.6 23.0 50.3 11.0 7.2 3.8 0.0 3.7 50.5 49.5 762 10.9 HomeBased 58.5 27.1 5.0 9.4 1.6 20.0 0.8 0.6 84.8 5.8 62.0 22.2 13.3 24.1 6.5 16.9 20.3 44.2 31.2 10.9 59.3 14.5 4.1 10.3 0.1 4.3 49.5 50.5 1,335 8.5 Foster Care 59.9 31.7 4.3 4.1 1.9 21.0 0.4 1.2 37.2 41.1 17.6 23.2 10.5 30.0 20.2 19.2 18.8 42.5 37.2 10.6 48.2 19.1 9.9 7.4 1.8 3.8 44.9 55.1 734 14.5 Shelter Care 71.4 19.7 2.8 6.2 2.9 34.2 0.8 1.4 39.4 44.7 31.6 31.4 28.3 34.7 15.5 40.0 60.0 48.2 31.2 21.9 55.6 21.8 6.2 15.1 0.5 5.2 62.0 38.0 1,992 14.2 Residential Care 79.4 16.8 0.9 2.8 1.0 28.0 0.9 0.0 16.8 7.5 9.3 26.2 19.6 32.7 16.8 36.4 73.8 45.8 24.3 33.6 49.5 11.3 3.8 7.5 0.0 4.1 45.8 54.2 107 13.0 Crisis Stabilization Unless otherwise noted, numbers refer to percentages of affirmative responses. Parent rights indicated if one or both parents had rights terminated. Number of youth Age (Mean) Gender Male Female Ethnicity Caucasian African-American Hispanic Other # Placements (Mean) Past home-based Services Pregnant Have child(ren) CHINS Delinquent Neglect Physical abuse Sexual abuse Witness domestic violence Repeated grade Special education Psychotropic medication Parent substance abuse Parent incarceration Parent diagnosis Single-parent family Parent rights terminated: One parent Both parents Adoptive parents Risk Score (Mean) Variable Child Risk Factor Survey – All Program Types (2005) Characteristics of Youth Served in 2005 Characteristics of Youth Served in 2005 Child Risk Factor Survey – Residential Care Program Subtypes (2005) Variable Number of youth Age (Mean) Gender Male Female Ethnicity Caucasian African-American Hispanic Other # placements (Mean) Past home-based services Pregnant Have child(ren) CHINS Delinquent Neglect Physical abuse Sexual abuse Witness violence Repeated grade Special education Psychotropic medication Parent substance abuse Parent incarceration Parent diagnosis Single-parent family Parent rights terminated One parent Both parents Adoptive parents Risk Score (Mean) Residential Care – Combined 1,992 14.2 Public School 249 15.0 Public and On-Grounds 1,347 14.3 Locked Secure 396 13.3 62.0 38.0 34.3 65.7 68.4 31.6 57.9 42.1 71.4 19.7 2.8 6.2 2.9 34.2 0.8 1.4 39.4 44.7 31.6 31.4 28.3 34.7 15.5 40.0 60.0 48.2 31.2 21.9 55.6 21.8 6.2 15.1 0.5 5.2 73.5 22.1 0.8 3.6 2.8 28.9 3.6 3.2 39.8 58.6 37.8 19.7 11.6 34.1 14.5 30.1 29.3 39.8 28.1 13.7 61.8 19.2 7.7 11.5 0.0 4.5 72.1 18.8 2.7 6.5 2.7 35.6 0.4 1.3 42.5 48.0 31.2 31.8 30.1 32.9 17.6 39.2 57.9 47.9 33.0 19.7 53.7 20.5 5.5 14.4 0.6 5.2 67.8 21.6 4.3 6.4 3.5 32.8 0.3 0.5 28.3 25.0 29.0 37.4 32.6 41.2 8.8 49.0 86.6 54.5 27.0 34.6 58.1 27.8 8.1 19.5 0.3 5.6 Unless otherwise noted, numbers refer to percentages of affirmative responses. Parent rights indicated if one or both parents had rights terminated. 5 Day Treatment 172 47.2 7.1 0.52 3.8 Transitional Living 242 62.2 4.8 n/a n/a 63.8 5.3 0.46 3.4 762 HomeBased 60.8 4.5 0.63 5.6 1,335 Foster Care 55.5 6.0 n/a n/a 734 Shelter Care 46.2 8.8 0.50 3.6 2,021 Residential Care 30.4 8.0 n/a n/a 107 Crisis Stabilization * These clinical outcomes list the average score identified for the youth at program admission. The score is based upon the child’s clinical functioning for the 12 months prior to admission. GAF=Global Assessment of Functioning. CPC=Child Problem Checklist. FRS=Family Risk Scales, Parent Centered Risk. FPC=Family Problem Checklist. n/a = data not collected on this item for the program type. Number of youth Clinical Outcomes GAF at intake (Mean) CPC at intake (Mean) FRS at intake (Mean) FPC at intake (Mean) Variable Child and Family Clinical Functioning at Intake* – All Program Types (2005) Outcomes for Calendar Year 2005 & Cross-Year Comparisons for 1998-2005 6 Outcomes for Calendar Year 2005 & Cross-Year Comparisons for 1998-2005 Child and Family Clinical Functioning at Intake* – Residential Care Program Subtypes (2005) Residential Care – Combined 2,021 Public and OnGrounds 1,349 Public Locked Variable School Secure Number of youth 276 396 Clinical Outcomes GAF at intake (mean) 46.2 57.2 45.7 40.4 CPC at intake (mean) 8.8 7.5 8.8 9.9 FRS at intake (mean) 0.50 0.56 0.50 0.46 FPC at intake (mean) 3.6 5.2 3.4 3.0 * These clinical outcomes list the average score identified for the youth at program admission. The score is based upon the child’s clinical functioning for the 12 months prior to admission. GAF=Global Assessment of Functioning. CPC=Child Problem Checklist. FRS=Family Risk Scales, Parent Centered Risk. FPC=Family Problem Checklist. n/a = data not collected on this item for the program type. 7 Outcomes for Calendar Year 2005 & Cross-Year Comparisons for 1998-2005 Youth Leaving Care in 2005 Highlights These highlights report the range of percentage rates across the various program types. A positive educational outcome was noted at discharge for between 64.0% and 89.7% of the youth. At the time of follow-up, between 71.4% and 96.0% of youth had either graduated or were attending school. At discharge, between 3.9% and 56.0% of youth 16 years of age and older were employed. Youth in programs that are more restrictive (e.g., Residential Care with Locked and Staff Secure) tended to have lower rates of employment at discharge. Youth living in a home environment (e.g., Home-Based or Foster Care) tended to have higher rates of employment. The difference between the programs may also be related to lower sample sizes with some programs (e.g., Day Treatment), or related to the opportunities afforded and emphases given to employment among the different program types. At follow-up, between 22.4% and 51.5% of youth 16 years of age and older were employed. A majority of youth had experienced no new abuse at the time of follow-up (between 94.7% and 100.0%). Most of the youth experienced no new court involvement at the time of follow-up (between 75.0% and 95.6%). Cross-Year Comparison of No New Abuse of Youth at Follow-Up 1999-20053 100% 98% 96% 94% Residential Care Foster Care Transitional Living 92% Home-Based Day Treatment 90% 1999 3 2000 2001 2002 2003 2004 2005 Follow-Up was conducted 6 months after discharge for Foster Care and Residential Care. Follow-Up was conducted 3 months after discharge for Transitional Living, Home-Based and Day Treatment. Follow-Up data is not collected for Crisis Stabilization and Shelter Care. 8 9 Day Treatment 102 214.3 130.0 53.4 5.6 0.51 3.4 64.0 16.2 24.8 44.6 26.7 4.0 13.7 (51.8) 57.6 23.9 13.0 5.4 5.3 6.1 6.4 Transitional Living 215 209.6 170.0 60.8 3.9 n/a n/a 79.7 56.0 20.7 5.3 58.2 15.9 37.5 (52.3) 51.2 14.1 15.5 19.2 5.5 n/a 6.1 6.1 6.5 6.3 73.2 3.8 21.8 1.3 14.2 77.3 7.6 0.9 22.0 (69.4) 81.7 31.5 69.4 3.3 0.41 2.3 576 203.0 165.5 HomeBased 5.7 5.9 6.0 67.4 9.2 19.7 3.6 19.1 8.1 71.2 1.5 56.8 (67.6) 80.8 28.9 63.7 3.9 0.42 2.3 985 350.2 222.0 Foster Care n/a n/a 6.1 81.3 4.8 9.8 4.0 24.8 4.3 67.4 3.5 19.8 (52.7) n/a n/a 57.8 4.9 n/a n/a 609 37.6 21.0 Shelter Care 5.4 6.0 6.1 71.8 10.7 13.2 4.3 16.6 5.2 75.0 3.2 41.0 (62.1) 82.7 16.7 54.8 5.1 0.43 2.5 1,734 259.7 195.5 Residential Care 4.6 6.0 5.4 97.2 0.0 2.8 0.0 2.9 11.6 85.5 0.0 7.6 (83.3) n/a n/a 47.4 3.3 n/a n/a 72 12.1 8.0 Crisis Stabilization Checklist. ROLES=Restrictiveness of Living Environment Scale; Permanency Plan achieved refers to either primary or concurrent plan achieved. Education and employment are reported for the percent of youth who are of appropriate age. n/a = data not collected on this item for the program type. Unless otherwise noted, numbers refer to percentages of affirmative responses. Due to rounding, some percentage totals may not equal 100.0%. GAF=Global Assessment of Functioning. CPC=Child Problem Checklist. FRS=Family Risk Scales, Parent Centered Risk. FPC=Family Problem Number of youth Length of Stay: Mean Median Clinical Outcomes GAF mean at discharge (Mean) CPC mean at discharge (Mean) FRS mean at discharge (Mean) FPC mean at discharge (Mean) Functional Outcomes Positive education at discharge Employed at discharge Placement Outcomes ROLES at discharge More restrictive Similar restrictiveness Less restrictive Runaway Permanency plan achieved (only those with required plan) Nature of Discharge Planned Removed by referring source Administrative discharge Runaway Satisfaction Outcomes Child (Mean) Parent (Mean) Referring source (Mean) Variable Discharge Outcome Summary – All Program Types (2005) Outcomes for Calendar Year 2005 & Cross-Year Comparisons for 1998-2005 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Discharge Outcome Summary – Residential Care Program Subtypes (2005) Variable Number of youth Length of Stay: Mean Median Clinical Outcomes GAF mean at discharge (Mean) CPC mean at discharge (Mean) FRS mean at discharge (Mean) FPC mean at discharge (Mean) Functional Outcomes Positive education at discharge Employed at discharge Placement Outcomes ROLES at discharge More restrictive Similar restrictiveness Less restrictive Runaway Permanency plan achieved (only those with plan required) Nature of discharge Planned Removed by referring source Administrative discharge Runaway Satisfaction Outcomes Child (Mean) Parent (Mean) Referring source (Mean) Residential Care – Combined 1,734 259.7 195.5 Public School 213 127.0 92.0 Public and OnGrounds 1,186 310.8 243.5 Locked Secure 337 182.5 136.0 54.8 5.1 0.43 2.5 59.7 6.0 0.51 4.7 54.4 5.2 0.42 2.4 53.1 4.2 0.39 1.8 82.7 16.7 71.8 35.3 82.7 16.4 89.7 3.9 16.6 5.2 75.0 3.2 41.0 (62.1) 17.1 5.7 68.7 8.5 31.5 (54.7) 19.4 5.3 72.3 3.1 46.7 (64.6) 6.5 4.8 88.4 0.3 26.9 (54.5) 71.8 10.7 13.2 4.3 57.1 17.1 15.2 10.5 70.0 10.8 14.9 4.3 87.1 6.3 6.3 0.3 5.4 6.0 6.1 5.1 5.6 6.5 5.4 5.9 6.1 5.5 6.3 5.9 Unless otherwise noted, numbers refer to percentages of affirmative responses. Due to rounding, some percentage totals may not equal 100.0%. GAF=Global Assessment of Functioning. CPC=Child Problem Checklist. FRS=Family Risk Scales, Parent Centered Risk. FPC=Family Problem Checklist. ROLES=Restrictiveness of Living Environment Scale. Permanency Plan achieved refers to either primary or concurrent plan achieved. Education and employment are reported for the percent of youth who are of appropriate age. 10 11 Day Treatment 40 0.40 96.0 50.0 94.7 97.4 92.5 16.2 81.1 2.7 0.0 Transitional Living 120 n/a 71.4 45.9 99.1 n/a 81.7 13.0 62.6 24.3 0.0 6.4 75.4 18.2 0.0 91.7 51.5 98.4 97.8 89.9 0.37 201 Home-Based 10.0 76.2 13.7 0.2 94.1 31.1 97.8 98.2 95.6 0.37 575 Foster Care 14.7 67.5 16.9 0.8 91.5 29.2 98.6 98.6 80.9 0.38 954 Residential Care Unless otherwise noted, numbers refer to percentages of affirmative responses. Due to rounding, some percentage totals may not equal 100.0%. GAF=Global Assessment of Functioning; CPC = Child Problem Checklist. FRS=Family Risk Scales, Parent Centered Risk; ROLES=Restrictiveness of Living Environment Scale. Education and employment are reported for the percent of youth who are of appropriate age. n/a = data not collected on this item for the program type. Number of youth contacted Clinical Outcomes FRS mean at follow-up Functional Outcomes Positive education at follow-up Employed at follow-up No new abuse of child No new abuse in family No new court involvement Placement Outcomes ROLES at follow-up More restrictive Similar restrictiveness Less restrictive Runaway Variable Follow-up Outcome Summary – All Program Types (2005) Outcomes for Calendar Year 2005 & Cross-Year Comparisons Outcomes for Calendar Year 2005 & Cross-Year Comparisons Follow-up Outcome Summary – Residential Care Program Subtypes (2005) Variable Number of youth contacted Clinical Outcomes FRS mean at follow-up Functional Outcomes Positive education at follow-up Employed at follow-up No new abuse of child No new abuse in family No new court involvement Placement Outcomes ROLES at follow-up More restrictive Similar restrictiveness Less restrictive Runaway Residential Care – Combined 954 Public School 130 Public and OnGrounds 659 Locked Secure 165 0.38 0.47 0.38 0.35 91.5 29.2 98.6 98.6 80.9 89.9 35.7 100.0 100.0 75.0 92.2 29.5 98.2 98.7 81.7 90.3 22.4 98.8 97.4 82.7 14.7 67.5 16.9 0.8 22.4 60.8 16.8 0.0 14.1 68.3 16.8 0.8 11.3 70.0 17.5 1.3 Unless otherwise noted, numbers refer to percentages of affirmative responses. Due to rounding, some percentage totals may not equal 100.0%. FRS=Family Risk Scales, Parent Centered Risk; ROLES=Restrictiveness of Living Environment Scale 12 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Transitional Living Functional Outcomes – 2005‡ 100% Discharge Follow-up 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Education Employment No Child Abuse Parent Rights Terminated – 2005 Parent rights terminated: 31.8% For one parent 9.6% For both parents 21.8% For adoptive parents 0.4% No Court Involvement Restrictiveness of Living Environment Scales at Discharge - 2005 Runaway 15.9% More 20.7% Outcome Highlights from 2005 Over half of the youth were discharged according to goals set in their permanency plan (52.3%). Close to 4 in 5 youth were in school at discharge (79.7%). Over 7 of every 10 youth demonstrated a positive educational outcome at follow-up (71.4%). Over 3 of every 5 (63.5%) youth were in similar or less restrictive places at discharge. At follow-up, this was true for 9 in 10 (86.9%) youth. Two of 10 youth returned to court during the follow-up period because of a new infraction (81.7%). ‡ Education and employment outcome variables are reported for the percent of youth who are of appropriate age who had a positive outcome. Education (Discharge n=172; Follow-up n=84); Employment (Discharge n=200; Follow-up n=85); Child abuse (n=114); Court involvement (n=115). 13 Same 5.3% Less 58.1% Outcomes for Calendar Year 2005 & Cross-Year Comparisons Transitional Living Percent of Youth with Successful Functional Outcomes at Discharge – Cross-Year Comparison 100% Education 90% Employment 80% 70% 60% 50% 40% 30% 20% 10% 0% 1998 1999 2000 2001 2002 2003 2004 2005 Percent of Youth in a Similar or Less Restrictive Placement – Cross-Year Comparison Discharge Follow-up 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 1998 1999 2000 2001 2002 14 2003 2004 2005 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Day Treatment Functional Outcomes – 2005‡ 100% Discharge Follow-up 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Education Employment No Child Abuse Parent Rights Terminated – 2005 Parent rights terminated: 15.2% For one parent 7.3% For both parents 7.9% For adoptive parents 0.0% Outcome Highlights from 2005 No Family Abuse Restrictiveness of Living Environment Scales at Discharge - 2005 Less 26.7% Same 44.6% Two in 3 youth had positive educational outcomes at discharge (64.0%). Of youth over the age of 16, about 1 in 6 was employed at discharge (16.2%). Just over 7 in 10 youth were placed in a similarly or less restrictive environment at discharge (71.3). The sample at follow-up, although small in size, reported positive outcomes in education, employment, and placement. Also, few youth were subject to abuse and few had returned to court for a new infraction. ‡ No Court Involvement Runaway 4.0% More 24.8% Education and employment outcome variables are reported for the percent of youth who are of appropriate age who had a positive outcome. Education (Discharge n=89; Follow-up n=25); Employment (Discharge n=37; Follow-up n=10); Child abuse (n=38); Family abuse (n=38); Court involvement (n=40). 15 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Day Treatment4 Percent of Youth with Successful Functional Outcomes at Discharge – Cross-Year Comparison 100% Education Employment 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 2003 2004 2005 Percent of Youth in a Similar or Less Restrictive Placement – Cross-Year Comparison 100% Discharge Follow-up 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 2003 4 2004 Outcomes for Day Treatment programs have been collected since 2003. 16 2005 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Home-Based Functional Outcomes – 2005‡ 100% Discharge 90% Follow-up 80% 70% 60% 50% 40% 30% 20% 10% 0% Education Employment No Child Abuse Parent Rights Terminated – 2005 Parent rights terminated: 11.0% For one parent 7.2% For both parents 3.8% For adoptive parents 0.0% No Family Abuse Restrictiveness of Living Environment Scales at Discharge - 2005 Same 77.3% Outcome Highlights from 2005 Over 4 in 5 youth had positive educational outcomes at discharge (81.7%); at follow-up, 9 out of 10 youth had a positive outcome (91.7%). Almost 85% of youth were placed in a similarly or less restrictive placement at discharge. Over 9 of every 10 youth contacted at follow-up were in similar or less restrictive settings (93.6%). Suspected or substantiated abuse occurred in less than 3% of youth contacted at follow-up. At follow-up, 9 in 10 of those contacted had not returned to court (89.9%). ‡ No Court Involvement Less 7.6% Runaway 0.9% More 14.2% Education and employment outcome variables are reported for the percent of youth who are of appropriate age who had a positive outcome. Education (Discharge n=431; Follow-up n=120); Employment (Discharge n=181; Follow-up n=66); Child abuse (n=184); Family abuse (n=183); Court involvement (n=199). 17 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Home-Based Percent of Youth with Successful Functional Outcomes at Discharge – Cross-Year Comparison 100% Education Employment 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 2001 2002 2003 2004 2005 Percent of Youth in a Similar or Less Restrictive Placement – Cross-Year Comparison Discharge Follow-up 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 2001 2002 2003 18 2004 2005 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Foster Care Functional Outcomes – 2005‡ 100% Discharge Follow-up 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Education Employment No Child Abuse No Family Abuse Parent Rights Terminated – 2005 Parent rights terminated: 14.5% For one parent 4.1% For both parents 10.3% For adoptive parents 0.1% Restrictiveness of Living Environment Scales at Discharge - 2005 Runaway 1.5% Less 71.3% Outcome Highlights from 2005 The average age of children entering Foster Care was 8.5 years. In 1999, the average age was 10.9 years; since then, the average age has steadily decreased. Four of every 5 youth (80.8%) had a positive educational outcome at discharge. Over 9 of every 10 youth (94.1%) had a positive educational outcome at follow-up. Nearly 4 of every 5 youth were placed in a less or similarly restrictive placement at discharge (79.3%). This was the case for almost 9 in 10 youth at follow-up (89.9%). ‡ No Court Involvement More 19.1% Same 8.1% Education and employment outcome variables are reported for the percent of youth who are of appropriate age who had a positive outcome. Education (Discharge n=681; Follow-up n=393); Employment (Discharge n=235; Follow-up n=119); Child abuse (n=539); Family abuse (n=536); Court involvement (n=551). 19 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Foster Care Percent of Youth with Successful Functional Outcomes at Discharge – Cross-Year Comparison 100% Education Employment 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 1998 1999 2000 2001 2002 2003 2004 2005 Percent of Youth in a Similar or Less Restrictive Placement – Cross-Year Comparison Discharge Follow-up 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 1998 1999 2000 2001 2002 20 2003 2004 2005 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Shelter Care Parent Rights Terminated – 2005 Parent rights terminated: 19.1% For one parent 9.9% For both parents 7.4% For adoptive parents 1.8% Outcome Highlights from 2005 Restrictiveness of Living Environment Scales at Discharge - 2005 Runaway 1.5% Less Average program length was just over 71.3% five weeks (37.5 days). Seven of every 10 youth (71.7%) were discharged to a less or equally restrictive placement. Over 8 of every 10 youth were discharged according to program plan (81.3%). More 19.1% Same 8.1% Percent of Youth in a Similar or Less Restrictive Placement – Cross-Year Comparison 100% Discharge 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 2004 2005 21 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Residential Programs Utilizing Public Schools Functional Outcomes – 2005‡ 100% Discharge 90% Follow-up 80% 70% 60% 50% 40% 30% 20% 10% 0% Education Employment No Child Abuse Parent Rights Terminated – 2005 Parent rights terminated: 19.2% For one parent 7.7% For both parents 11.5% For adoptive parents 0.0% No Court Involvement Restrictiveness of Living Environment Scales at Discharge - 2005 Less 68.7% Outcome Highlights from 2005 Over 7 in 10 youth (71.8%) had a positive education outcome at discharge. Nearly 9 in 10 youth had a positive education outcome at follow-up (89.9%). Over 2 of every 3 youth were placed in less or equally restrictive placements at discharge (74.4%). At follow-up, over three-fourths were in similar settings (77.6%). Those contacted at follow-up reported no new abuse. ‡ No Family Abuse Runaway 8.5% More 17.1% Same 5.7% Education and employment outcome variables are reported for the percent of youth who are of appropriate age who had a positive outcome. Education (Discharge n=195; Follow-up n=99); Employment (Discharge n=116; Follow-up n=70); Child abuse (n=121); Family abuse (n=120); Court involvement (n=128). 22 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Residential Programs Utilizing Public Schools Percent of Youth with Successful Functional Outcomes at Discharge – Cross-Year Comparison 100% Education Employment 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 1999 2000 2001 2002 2003 2004 2005 Percent of Youth in a Similar or Less Restrictive Placement – Cross-Year Comparison 100% Discharge Follow-up 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 1999 2000 2001 2002 23 2003 2004 2005 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Residential Programs Utilizing Public and On-Grounds Schools Functional Outcomes – 2005‡ 100% Discharge 90% Follow-up 80% 70% 60% 50% 40% 30% 20% 10% 0% Education Employment No Child Abuse Parent Rights Terminated – 2005 Parent rights terminated: 20.5% For one parent 5.5% For both parents 14.4% For adoptive parents 0.6% No Family Abuse Restrictiveness of Living Environment Scales at Discharge - 2005 Runaway 3.1% Less 72.2% Outcome Highlights from 2005 Approximately 4 of very 5 youth (82.7%) had a positive educational outcome at discharge. Nine of every 10 youth (92.2%) had a positive educational outcome at follow-up. Nearly 8 of every 10 youth (77.5%) were placed in a similar or less restrictive setting when discharged. Over 85% of those contacted at follow-up reported similar placements. Nearly all youth (98.2%) experienced no new abuse at time of follow-up. Four of every 5 youth had not been in court for a new infraction (81.7%). ‡ No Court Involvement More 19.4% Same 5.3% Education and employment outcome variables are reported for the percent of youth who are of appropriate age who had a positive outcome. Education (Discharge n=1,092; Follow-up n=486); Employment (Discharge n=634; Follow-up n=333); Child abuse (n=621); Family abuse (n=621); Court involvement (n=644). 24 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Residential Programs Utilizing Public and On-Grounds Schools Percent of Youth with Successful Functional Outcomes at Discharge – Cross-Year Comparison 100% Education Employment 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 1999 2000 2001 2002 2003 2004 2005 Percent of Youth in a Similar or Less Restrictive Placement – Cross-Year Comparison 100% Discharge Follow-up 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 1999 2000 2001 2002 25 2003 2004 2005 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Residential Locked & Staff Secure Functional Outcomes – 2005‡ 100% Discharge 90% Follow-up 80% 70% 60% 50% 40% 30% 20% 10% 0% Education Employment No Child Abuse No Family Abuse Restrictiveness of Living Environment Scales at Discharge - 2005 Parent Rights Terminated – 2005 Parent rights terminated: 27.9% For one parent 8.1% For both parents 19.5% For adoptive parents 0.3% Outcome Highlights from 2005 No Court Involvement Less 88.4% Nearly 9 in 10 youth experienced a positive educational outcome at discharge (89.7%). Nearly 9 in 10 youth (88.4%) were placed in a less restrictive placement at discharge. A similar percentage (87.5%) was reported for follow-up for placement in similar or less restrictive placement. A majority of youth experienced no new abuse (98.8%) at follow-up. Over 4 in 5 youth had no new court involvement (82.7%) at follow-up. ‡ Runaway 0.3% More 6.5% Same 4.8% Education and employment outcome variables are reported for the percent of youth who are of appropriate age who had a positive outcome. Education (Discharge n=320; Follow-up n=134); Employment (Discharge n=155; Follow-up n=85); Child abuse (n=160); Family abuse (n=159); Court involvement (n=162). 26 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Residential Locked & Staff Secure Percent of Youth with Successful Functional Outcomes at Discharge – Cross-Year Comparison 100% Education Employment 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 1999 2000 2001 2002 2003 2004 2005 Percent of Youth in a Similar or Less Restrictive Placement – Cross-Year Comparison Discharge Follow-up 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 1999 2000 2001 2002 27 2003 2004 2005 Outcomes for Calendar Year 2005 & Cross-Year Comparisons Crisis Stabilization Restrictiveness of Living Environment Scales at Discharge - 2005 Parent Rights Terminated – 2005 Parent rights terminated: 11.3% For one parent 3.8% For both parents 7.5% For adoptive parents 0.0% Less 85.5% More 2.9% Outcome Highlights from 2005 Youth remained in this program an average of 12.1 days. Most all youth (97.1%) were placed in a less or equally restrictive setting at discharge (e.g., two-thirds went to their parent’s home). Most all youth were planfully discharged (97.2%). Same 11.6% Percent of Youth in a Similar or Less Restrictive Placement – Cross-Year Comparison 100% Discharge 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 2004 2005 28 Conclusions Conclusions The 2005 results are consistent with previous years of analyses for the Project. Youth entering care in the various programs during 2005 present with a variety of significant child- and parent-specific risk and protective factors. Youth discharged from programs appear to be functioning better than the youth admitted to that program. In addition, youth contacted at follow-up demonstrate similar levels of functioning to those at discharge, suggesting that better functioning is maintained for several beyond program discharge. In some programs, more youth are entering their current program after having their parents’ rights terminated. This is especially true in Residential and Transitional Living programs. Although youth admitted present with significant problems, those leaving treatment consistently demonstrate positive outcomes at discharge, including educational outcomes and movement to a similar or less restrictive placement. Employment outcomes vary more across the years than do other functional and placement outcomes. This greater variability may be due to greater fluctuations in sample size (since in many programs the majority of youth are not of employment age), factors external to the program (e.g., changes in local unemployment rates impacting job availability) and how focused each agency and program is on employment for their youth of employment age. There continues to be a steady increase in the number of cases submitted for the Project. This is important to consider, since fewer agencies are participating. Further examination of this increase in cases per agency may yield information for IARCCA and its member agencies. For example, investigation of placement rates across the state may help determine whether or not the population of youth needing out-of-home care is contributing to this increase. In addition, the relationship between lengths of stay and placement rates should be investigated to determine if the increase reflects greater agency capacity to serve children in a given year. Another possibility is that agencies are able to complete the Project packets for more of the youth and families they serve. A fourth possibility is that agencies are using the EON™ computer software developed for data collection. Additional analyses of trends should be monitored. With the advent this year of the EON™ software for data entry, more finely tuned analyses of youth receiving services are possible. For example, information on specific services received by youth and their families is now collected, and will allow for an investigation on how services received impact outcomes. Referral sources, parents, and interested parties are encouraged to review the data presented in this document and in the Annual Report for 2005. They are encouraged to contact individual agencies to discuss how their agency results compare with the state aggregated data. A discussion should ensue, to identify how the agencies’ referral base (e.g., problems and risk factors identified in youth the agency serves) are similar and different from the IARCCA aggregate, as this could explain differences in outcomes. 29 (Three Months) ¾ Difficulty of Family ¾ ROLES ¾ Education ¾ Employment ¾ New Court Follow-Up 30 (Three Months) ¾ ROLES ¾ Education ¾ Employment ¾ New Court Difficulty of Child ROLES Nature of Discharge Education Employment Satisfaction (Child, Placing Agency) ¾ Services ¾ ¾ ¾ ¾ ¾ ¾ ¾ Difficulty of Child ¾ Demographics Transitional Living Key: Difficulty of Child = Global Assessment of Functioning; Child Problem Checklist Difficulty of Family = Family Risk Scales; Family Problem Checklist Demographics = Child Risk Factor Survey ROLES = Restrictiveness of Living Environment Scale Nature of Discharge = Nature of Discharge; Permanency Plan Met Education = Education Outcome Employment = Employed if age 16 or older Satisfaction = Child Survey; Parent Survey; Placing Agency Survey Services = Services Form (Six Months) ¾ Difficulty of Family ¾ ROLES ¾ Education ¾ Employment ¾ New Court Difficulty of Child Difficulty of Family ROLES Nature of Discharge Education Employment Satisfaction (All) Services ¾ ¾ ¾ ¾ ¾ ¾ ¾ ¾ ¾ ¾ ¾ ¾ ¾ ¾ ¾ ¾ Discharge Difficulty of Child Difficulty of Family ROLES Nature of Discharge Education Employment Satisfaction (All) Services ¾ Difficulty of Child ¾ Difficulty of Family ¾ Demographics ¾ Difficulty of Child ¾ Difficulty of Family ¾ Demographics Foster Care & Residential Care Intake Home-Based & Day Treatment Data Collection across the Program Types ¾ ¾ ¾ ¾ N/A Difficulty of Child Nature of Discharge Satisfaction (All) Services ¾ Difficulty of Child ¾ Difficulty of Family ¾ Demographics Shelter Care & Crisis Stabilization Appendix Program Types Evaluated & Outcome Measures Assessed Appendix IARCCA Outcome Measures Project Participating Agencies (2005) Resource Inc., Indianapolis Shults-Lewis Child & Family Services, Valparaiso Specialized Alternatives for Families and Youth, Indianapolis St. Margaret Mercy Healthcare Center, Dyer Triple L Youth Ranch, Anderson United Methodist Youth Home, Evansville Vigo County Homes for Children, Terre Haute The Villages of Indiana, Bloomington & Indianapolis Wernle, Inc. Services for Children and Families, Richmond White’s Residential and Family Services, Wabash Whitewater Valley Care Pavilion, Connersville Whitington Homes & Services for Children & Families, Columbia City Willowglen Academy, Gary Wyandotte House, Corydon Youth Encouragement Services, Aurora Youth Hope, Columbus Youth Opportunity Center, Muncie Youth Service Bureau, Jay County, Portland Youth Services Center of Allen County, Ft. Wayne Ada’s Place, Indianapolis Anderson Center of St. John’s Health System, Anderson Anchor Families, New Castle Baptist Children’s Home, Valparaiso Bashor Home of the United Methodist Church, Goshen Campagna Academy, Schererville Childplace, Jeffersonville Children’s Bureau, Inc., Indianapolis The Children’s Campus Inc., Mishawaka Children’s Sanctuary, Ft. Wayne Christian Haven, Wheatfield Crisis Center Inc., Gary Crossroad, Fort Wayne Damar Services, Inc., Camby Debra Corn Agency, Winslow Edgewater Systems for Balanced Living, Gary Fairbanks, Indianapolis Family Service Society, Marion Floyd County Youth Service Bureau, New Albany Fresh Start Home, Elizabethtown Friendship Home, Kokomo Gateway Woods, Leo George Jr. Republic in Indiana, Columbus Gibault, Inc., Terre Haute Group Homes for Children, Lafayette Hamilton Centers Youth Service Bureau Inc., Noblesville Hillcrest-Washington Youth Home, Evansville Indiana United Methodist Children’s Home, Lebanon Indiana Youth Advocate Program, Indianapolis Jefferson County Youth Shelter, Madison Lifeline Youth and Family Services, Ft. Wayne Lutheran Child and Family Services, Indianapolis Madison Center, South Bend Mentor, Highland Middle Passage, Gary Midwest Center for Youth and Families, Kouts Midwest Institute, Indianapolis New Horizons Youth Ministries, Marion N.O.A.H., Inc., Indianapolis Oaklawn, Goshen Prep Program, Bloomington Regional Youth Services Inc., Jeffersonville Resolute Program, Indianapolis 31 Appendix IARCCA Outcome Project Committee Members (2005) Gina Alexander, MSW, MS Monique Busch, MSW, ACSW Elaine Daniel C.L. Day, MSW Cathleen Graham, MSW, LCSW Bruce Hillman Kristen Kinder John Link, MS, LMFT Don Mobley Jessica Morris Vicki Murgaw Dan Peck, MSW, LCSW Jennifer Rolsen, BA Jeff Schumacher, MS Jenny Sisson Rebecca Stevens, MS Jennifer Vanskyock The Villages of Indiana, Inc. IARCCA IARCCA N.O.A.H., Inc. IARCCA Campagna Academy Bashor Crossroad – Ft. Wayne Children’s Home Wernle, Inc. Whitewater Valley Care Pavilion Triple L Youth / Family Connection, Inc. Oaklawn Crossroad – Ft. Wayne Children’s Home Gateway Woods Youth Opportunity Center Gibault, Inc. Youth Service Bureau, Jay Co. Author Notes Jacqueline Remondet Wall, Ph.D., is currently the Director of Undergraduate Programs at the School of Psychological Sciences (SoPS), University of Indianapolis. She also holds the academic rank of Assistant Professor in the SoPS. Her doctorate degree is in industrial / organizational psychology. She completed a post-doctoral respecialization in clinical psychology, and a National Institutes of Health post-doctoral fellowship with an emphasis in neuropsychology and rehabilitation psychology. Dr. Wall is licensed to practice psychology in the state of Indiana. She has evaluated individuals, services, and programs in industry, academia, and health care. Her work has included developing selection systems for industry, serving as an objective reviewer for a federal grant program, working on a statewide needs assessment to predicted employment patterns for older adults, performing training needs analyses and conducting program evaluation activities, including those for professional continuing education. She has served as an external evaluator with IARCCA since 1998. Steven M. Koch, Ph.D., is currently the Interdisciplinary Training Director for the Riley Child Development Center, located in the James Whitcomb Riley Hospital for Children. He is a clinical assistant professor in pediatrics at the Indiana University School of Medicine, adjunct assistant professor at Indiana University School of Education, and adjunct professor at the University of Indianapolis School of Psychological Sciences. Dr. Koch completed his doctoral degree in school psychology, with a minor concentration in research and evaluation. He is licensed as both a clinical psychologist and as a school psychologist in the state of Indiana, and has been involved in individual- and program evaluation activities for the past eleven years, and has been involved with the IARCCA Outcome Measures Project since 1996. 32