Evaluating Interrelate`s School Education
Transcription
Evaluating Interrelate`s School Education
Southern Cross University ePublications@SCU Centre for Children and Young People 2011 Evaluating Interrelate's School Education Programs: Moving Into the Teen Years Sallie Newell Centre for Children and Young People, Southern Cross University Wendy Britt Centre for Children and Young People, Southern Cross University Anne Graham Centre for Children and Young People, Southern Cross University Publication details Newell, S, Britt, W & Graham, A 2011, Evaluating Interrelate's School Education Programs: Moving Into the Teen Years, report prepared for Interrelate Family Centres, Sydney, NSW. ePublications@SCU is an electronic repository administered by Southern Cross University Library. Its goal is to capture and preserve the intellectual output of Southern Cross University authors and researchers, and to increase visibility and impact through open access to researchers around the world. For further information please contact epubs@scu.edu.au. EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: MOVING INTO THE TEEN YEARS June 2011 Prepared by: Dr Sallie Newell Mrs Wendy Britt Professor Anne Graham PLEASE CITE THIS DOCUMENT AS: Newell, S., Britt, W. & Graham, A. (2011). Evaluating Interrelate‟s School Education Programs: Moving Into The Teen Years. Prepared for Interrelate Family Centres: Sydney. ADDITIONAL COPIES OF THIS REPORT: Can be accessed at http://epubs.scu.edu.au/ccyp_pubs/34 ACKNOWLEDGMENTS The authors would like to gratefully acknowledge: The children and teachers who completed the program evaluation forms. The Interrelate Educators who facilitated the distribution and collection of the evaluation forms with their MITTY groups. Special thanks go to Lyndall Caldwell and Sally Sweeney for their invaluable collaboration in developing and promoting the use of these revised evaluation forms. The Interrelate School Services‟ administrative team for their assistance with collating the various evaluation forms used throughout this overall evaluation series. Colleagues at the CCYP for their critical feedback on draft versions of the survey questions. Interrelate Family Centres for engaging and partnering with us throughout this project. The Widjabul People and the Ngundawal Minjungbal People of the Bundjalung Nation, the Arakwal People and the Gumbaynggirr People. As the Traditional Custodians of the land where our University campuses are located, we pay tribute to the unique role they play in the life of our region. NOTE: All quotes from open survey responses are presented in this report exactly as they were written on the evaluation forms, including any typographical or grammatical errors. FOR FURTHER INFORMATION PLEASE CONTACT: Dr Sallie Newell – Senior Research Officer Phone: 02 6620 3802 © 2011 Fax: 02 6620 3243 Email: sallie.newell@scu.edu.au Centre for Children and Young People This work may be reproduced, in whole or part, for study or training purposes, subject to the inclusion of an acknowledgement of the source. It should not be used for commercial purposes. The Centre welcomes feedback on both the development and implementation of this document from our partners. The Centre considers that collaboration with individuals, professionals, service providers and academic colleagues concerned with children can lead to better outcomes for children and young people. TABLE OF CONTENTS REPORT SUMMARY ................................................................................................................1 INTRODUCTION.....................................................................................................................3 BACKGROUND ............................................................................................................................. 3 INTERRELATE’S CURRENT SCHOOL EDUCATION PROGRAMS ................................................................. 3 PURPOSE OF THIS REPORT ............................................................................................................... 4 MORE ABOUT THE MOVING INTO THE TEEN YEARS PROGRAM .............................................................. 4 METHODS ..............................................................................................................................6 THE OVERALL APPROACH .............................................................................................................. 6 TOOL DEVELOPMENT ..................................................................................................................... 7 The Overall Process ................................................................................................................................. 7 Tools Used in Evaluating the MITTY Program ...................................................................................... 7 DATA COLLECTION ....................................................................................................................... 7 DATA ANALYSES ........................................................................................................................... 8 ETHICS ........................................................................................................................................ 8 RESULTS .................................................................................................................................9 SAMPLE CHARACTERISTICS ............................................................................................................. 9 PARTICIPANT FEEDBACK ABOUT THE MITTY PROGRAM ..................................................................... 10 Student Satisfaction .............................................................................................................................. 10 Teacher Satisfaction ............................................................................................................................. 12 PERCEIVED LEARNINGS ................................................................................................................ 14 Overview of Student Learnings .......................................................................................................... 14 Learnings about Puberty ..................................................................................................................... 15 Learnings about Reproduction .......................................................................................................... 16 Learnings about Bodies and Sexuality .............................................................................................. 16 Self-related Learnings ........................................................................................................................... 17 Learnings about Relationships ............................................................................................................ 18 Teacher Learnings................................................................................................................................. 18 REFERENCES ........................................................................................................................20 APPENDICES .......................................................................................................................21 APPENDIX A: HOW MITTY CORRELATES TO THE NSW PD/H/PE SYLLABUS ......................................... 21 APPENDIX B: STUDENT EVALUATION FORM – MITTY PROGRAM ......................................................... 23 APPENDIX C: TEACHER EVALUATION FORM – MITTY PROGRAM ........................................................ 24 APPENDIX D: SCHOOLS INCLUDED IN EVALUATING THE MITTY PROGRAM........................................... 25 APPENDIX E: CODING TEACHERS’ WRITTEN RESPONSES TO OPEN-ENDED QUESTIONS ........................... 26 CENTRE FOR CHILDREN & YOUNG PEOPLE, SOUTHERN CROSS UNIVERSITY REPORT SUMMARY Moving Into The Teen Years (MITTY) is one of six relationship and sexuality education programs delivered by Interrelate Family Centres. It involves a series of four 90-minute class-based sessions (with a take-home workbook to encourage parental engagement). It is designed to enhance Year 6 students‟ self-esteem, communication and decision-making skills, to provide in-depth information about boys‟ and girls‟ bodies, the changes they can expect during puberty, reproduction and sexuality education. The MITTY program involves a variety of creative activities and teaching methods, is facilitated by specially trained Educators and has a clearly articulated structure, content and objectives, which have been correlated against the NSW Board of Studies‟ PD/H/PE syllabus. This evaluation report is based on data collected from 56 MITTY groups using surveys developed by the authors, in collaboration with Interrelate team members. Both students and teachers reported high levels of satisfaction with the MITTY program. Most students rated the MITTY program as enjoyable (particularly male and older students), interesting (particularly older students), good to have discussed in a group (particularly older students) and fun (particularly older students), although half also found it somewhat embarrassing (particularly female students). Very few students found it boring but one-third did find some bits hard to understand. Similarly, almost all teachers rated the MITTY program as enjoyable, interesting, engaging for their students, good value and good to have discussed in a group. One-third of teachers did find the program somewhat embarrassing but very few considered it too long or hard to understand. Teachers, in particular, were very appreciative of the Interrelate Educators‟ delivery style and of having an external professional to introduce the topics covered in the MITTY program. Students‟ and teachers‟ written comments reinforced these positive satisfaction ratings, with only a few suggestions for improvement. Both students and teachers also reported having found the MITTY program a very useful learning experience. Students reported moderate-high levels of learning across all topic areas, particularly in relation to keeping themselves safe, making good choices, how their bodies would change during puberty and how babies develop. The mixed-gender approach appears valuable (although there were a few requests for single-gender groups), with boys reporting having learned more about girls‟ bodies and vice versa. Similar levels of learning were reported across all student age-groups but female students reported learning more than males in relation to „Making good choices‟, „How babies are made‟ and „How to keep yourself safe‟. Teachers reported a refreshed understanding of the topics covered, increased confidence, capacity and comfort to discuss the topics covered with their students and having learned more about their students, particularly in terms of the open and mature ways in which they engaged with the program. Again, students‟ and teachers‟ written comments reinforced their perceived learnings from the MITTY program. While most teachers expected to talk more about the topics with their classes, students felt most likely to discuss them further with their family or friends (particularly the female students). Page|1 EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: Moving Into The Teen Years Although based on a post-only survey (for pragmatic reasons), the consistency of and concordance between participants’ ratings and written comments enhance our confidence in the validity of the findings presented in this report. This confidence is further strengthened by the very high response rates achieved from both students and teachers and the similar findings from our evaluations of Interrelate‟s Minding Me and Where Did I Come From? / Preparing for Puberty programs (Newell et al., 2011a; Newell et al., 2011b). Therefore, Interrelate can confidently promote the existing MITTY program as an acceptable, curriculum-relevant and effective way of introducing senior primary students to the topics covered (ie: self-esteem, communication and decision-making skills, boys‟ and girls‟ bodies, puberty, reproduction and sexuality). However, Interrelate might like to consider whether the MITTY program could usefully be further refined, based on the very few concerns or suggestions raised by students and/or teachers (although some comments may conflict with some requirements of the NSW Board of Studies). With the current evaluation necessarily limited to the immediate post-program period, Interrelate could also consider conducting some additional followup evaluations in order to determine the extent and nature of any longer-term impacts of the MITTY program. Hence, Interrelate is well-positioned to contribute to addressing the reported demand (from Australian parents and youth) for more comprehensive relationship and sexual health education, which is seen to include topics such as personal safety, sexual coercion, puberty, sexually-transmitted diseases, relationship decision-making, safe sex and contraception, reproduction and the correct names for male and female genitals (Carmody and Willis, 2006; Macbeth et al., 2009). The timing of Interrelate‟s Minding Me (Year 5) and MITTY (Year 6) programs is another strength, given most Australian parents‟ belief that this sexual education should start in primary school (Macbeth et al., 2009) and evidence that it has more impact when delivered before young people become sexually active (Mueller et al., 2008). The teacher involvement is also valuable, given parent- and teacher-perceived room for improvement in training teachers in the delivery of sexuality education (Macbeth et al., 2009; Milton, 2003). 2|Page CENTRE FOR CHILDREN & YOUNG PEOPLE, SOUTHERN CROSS UNIVERSITY INTRODUCTION BACKGROUND In 1926, Interrelate Family Centres (Interrelate) began its Father and Son and Mother and Daughter programs, delivering sexuality education to young people in New South Wales. Quality educational programs have remained a key component of Interrelate‟s expanding range of services and their dedicated and enthusiastic School Services team has earned a reputation as 'a respected and trusted leader in the delivery of sexuality and relationship education in NSW schools’. INTERRELATE’S CURRENT SCHOOL EDUCATION PROGRAMS In working towards their vision of being a „lighthouse‟ organisation for recognising children, Interrelate now offers a suite of six relationship and sexuality education programs for NSW children and their families. Each program is facilitated by specially trained Educators and has a clearly articulated structure, content and objectives, with the class-based programs having been correlated against the NSW Board of Studies‟ PD/H/PE syllabus: Where Did I Come From? – one 60-minute evening group session for students in Years 3-6 and their families – designed to inform students about the male and female reproductive systems, conception, foetal development, birth and the different ways in which children can join families and to facilitate parent-child discussions on these topics; Preparing for Puberty – one 60-minute evening group session for students in Years 5-6 and their families – designed to inform students about the physical, emotional, social and intellectual changes associated with puberty (for boys and for girls) and to facilitate parent-child discussions on these topics; Minding Me – two 90-minute class-based sessions for students in Year 5 – designed to provide students with information and strategies to help them navigate the physical, emotional, social and intellectual changes they may experience during puberty: Session 1 deals specifically with how relationships may change and developing mutual respect and good conflict resolution skills among students; Session 2 introduces the physical changes of male and female puberty and develops students‟ skills for identifying and addressing emotional and personal safety issues within their relationships; Moving into the Teen Years – a series of four 90-minute class-based sessions for students in Year 6 (with a take-home workbook to encourage parental engagement) – designed to enhance students‟ self-esteem, communication and decision-making skills (including taking care of themselves and taking responsibility), to provide in-depth information about boys‟ and girls‟ bodies, the changes they can expect during puberty, reproduction and sexuality education; Raising Awareness of Bullying – one 60-minute (younger groups) or 90-minute (older groups) class-based session with four age-tailored versions for students in each of Years 3, 4, 5 & 6 – designed to assist schools with concerns about harassment and/or physical abuse amongst pupils: Each session identifies the nature of bullying (including cyber bullying for older groups) and presents strategies for dealing with bullies from both victim and bystander perspectives; and, most recently, Kids ConneXions – two 90-minute class-based sessions for students in Year 6 – designed to improve students‟ understanding about and development of healthy relationships and to support them to make healthy choices and to build resilience in their relationships. Page|3 EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: Moving Into The Teen Years PURPOSE OF THIS REPORT In March 2010, Interrelate Family Centres commissioned Southern Cross University‟s Centre for Children & Young People to refine their existing program evaluation tools and, then, to use these new tools to conduct a large-scale evaluation of the above education programs. This report is one in a series of six presenting the results of this large-scale evaluation: There are separate reports for each of the four class-based program, a combined report covering the two evening programs and, finally, a Consolidated Report which brings together the key findings across all six programs. This report provides further background and describes the tool development and evaluation results for the program entitled Moving into the Teen Years. MORE ABOUT THE MOVING INTO THE TEEN YEARS PROGRAM The Moving into the Teen Years (MITTY) program was developed in response to requests from teachers and parents to help prepare students for their transition into high school and the teenage years. Consequently, the MITTY program was initially offered for students in the latter half of Year 6. However, it is now available year-round, following feedback from schools that participating boys and girls develop greater understanding and respect for each other, which was reflected in more positive attitudes for the rest of the year. MITTY involves a wide variety of creative activities and teaching methods, including discussions, student questions (written and asked), role plays, handouts to be completed at home with parent involvement, slideshow diagrams, games and other activities. At an age when talking about sex with adults can be embarrassing, Interrelate aims to deliver an enjoyable, as well as an informative, learning experience. The following table details the aims and content of each of the program‟s four sessions, as described in Interrelate‟s program overview. The MITTY program‟s content correlates well against the NSW Board of Study‟s Personal Development, Health & Physical Education (PD/H/PE) curriculum, as detailed in Appendix A. It is available year-round, to schools based in metropolitan areas of NSW (from Newcastle and the Hunter in the North, throughout Sydney and South to Wollongong and the Illawarra) and across the far North coast, on a fee-for-service basis, at a current cost of $28 per student for the four-session program. 4|Page CENTRE FOR CHILDREN & YOUNG PEOPLE, SOUTHERN CROSS UNIVERSITY MOVING INTO THE TEEN YEARS: OVERVIEW & SESSION OUTLINE SESSION AIMS 1 “Who Am I?” To relax the students, acknowledge their discomfort or embarrassment, get acquainted and initiate discussion. 2 “Look I'm Changing!” 3 “What’s It All About?” 4 “I’m In Charge” To set ground rules. To enhance students' self concept by helping them recognise their individuality and that being different is okay. For students to acquire knowledge of the basic physical differences between males and females particularly in relation to their Excretory and Reproductive Systems. To give students a detailed understanding of the changes, both physically and emotionally, which occur at puberty for boys, girls and both. To explain when and why these changes occur. To reassure students that these changes are normal and natural. To provide an opportunity for students to gain further understanding of the emotional changes experienced at puberty. To provide an opportunity to examine and practice strategies which can assist in dealing with issues students may encounter in adolescence. To give students a detailed understanding of the process of human reproduction, where we cover sexual intercourse & foetal development. To provide information on the birth processes and allow students to share knowledge of how they joined their family and/or their own birth experiences. To assist students to become further aware of their personal responsibilities, especially in regard to sexual intercourse where the consequences can be getting pregnant and/or sexually transmitted diseases. To raise student awareness of the need to respect and accept others. To give students an opportunity to think about and nominate people to whom they can turn for help. CONTENT Introduction and Opening Contracting / Class Rules or Guidelines Establishment of concepts of individuality and uniqueness Physical differences between males and females external genitalia and reproductive systems Excretory and reproductive systems of males and females Take home activities (handout letter) Conclusion - game Self-esteem building exercise (take home exercise) Question Box/Folder Strength Exercise (take home exercise) Changes at Puberty (male and female): Why, How and When – emotional and physical Take home activity Conclusion - game/exercise Self-esteem building exercise Take home exercise - male and female organs Question Box/Folder Feeling Exercise Decision Making Reproduction: Conception - IVF & sexual intercourse (as an adult, loving relationship), Fertilisation - how it happens, Foetal Development - changes, growth, stages, etc Take home activity Conclusion - game/exercise Self esteem building exercise Question Box/Folder Birth: Labour - explain stages, cervix dilation, Birth delivery positions, alternative birth situations, etc, After Birth - placental delivery, Caesarean Birth, Birth Video &/or birthing doll Sexual Responsibility: Role of parents, Needs of a baby, Teenage pregnancies, Sexually transmitted infections Agree/Disagree Activity Support Network: Who can I go to for help, information & support? Evaluation: Students and Teachers Conclusion - game Page|5 EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: Moving Into The Teen Years METHODS THE OVERALL APPROACH This evaluation utilised a collaborative, participatory methodology, reflecting the „evaluative learning‟ approach which has been refined by the CCYP in conducting almost 50 projects in partnership with community-based organisations (Newell et al., 2008). An evaluative learning approach typically incorporates elements from a variety of evaluation theories and models, particularly Empowerment Evaluation, which: “… aims to increase the probability of achieving program success by (1) providing program stakeholders with tools for assessing the planning, implementation and self-evaluation of their program and (2) mainstreaming evaluation as part of the planning and management of the program/organisation” (Fetterman and Wandersman, 2005 p.28). Empowerment Evaluation conceptualises an evaluator as a „critical friend‟ and is based on a fundamental belief in people‟s desire and capacity to understand their own situation and to create appropriate solutions, when provided with the necessary tools and conditions. This methodological approach was selected as the most appropriate for this project because the client organisation was interested in the development of an evaluation system that could be used routinely within their school education programs: Collaborative and participatory evaluation approaches are particularly well-suited to providing service organisations with rich and meaningful iterative feedback capable of enhancing programs‟ ultimate outcomes (Muir et al., 2009; Ryan, 2003); These approaches are also considered the most likely to contribute towards the growing need and demand for community organisations to develop their skills and take responsibility for evaluating their outcomes (Melville, 2008; Millar and Guenther, 2007; Our Community, 2003); and Maximising the active engagement of organisations and program participants in the evaluation process is also considered more ethical and socially just, which are seen as increasingly important in contemporary evaluation practice (Fetterman and Wandersman, 2005; Kushner, 2005; Schwandt, 2007; Schweigert, 2007). Another foundation of the CCYP‟s approach is the central place of children and young people in the evaluation process. Doing evaluation with (rather than on) children requires that researchers carefully consider the capacities and characteristics of the particular children who will be involved, in determining how they can be involved, meaningfully, safely and respectfully (Johnson, 2009; Tisdall et al., 2006). Our impetus to directly involve children reflects a growing acknowledgment that they are persons in their own right, worthy of recognition, respect and voice (Greene and Hill, 2005) and of the relationship between meaningful participation and actual wellbeing (de Winter et al., 1997). 6|Page CENTRE FOR CHILDREN & YOUNG PEOPLE, SOUTHERN CROSS UNIVERSITY TOOL DEVELOPMENT THE OVERALL PROCESS In keeping with the collaborative nature of this evaluation, the multidisciplinary CCYP research team worked with senior Educators and a Director from Interrelate to develop the forms and processes employed within this evaluation. As discussed earlier, this collaborative process encompassed the full range of Interrelate‟s school education programs and involved: CCYP researchers reviewing all available information about each program, including the evaluation tools previously used within them; An initial planning session (and ongoing interactions) involving both CCYP and Interrelate teams to determine the scope, focus, respondent groups, timeframe and most feasible methods for the evaluation (which was determined to be post-only, paper-based surveys due to the program‟s external and relatively time-intensive nature); CCYP researchers, with feedback from Interrelate Educators, drafting a full range of evaluation forms to cover the different attendees (students and parents or teachers) for each of Interrelate‟s six school education programs; Interrelate Educators piloting the draft evaluation forms with a few groups for each program and providing their own and their students‟ feedback about them; and CCYP researchers making revisions to produce the final range of evaluation forms to be used within this project. TOOLS USED IN EVALUATING THE MITTY PROGRAM As MITTY is a classroom-based program, evaluation forms were developed for completion by participating students and teachers (who attend with their class). Included in Appendices B and C, these surveys asked about each group‟s experience of attending the MITTY program, about their perceived learnings from it and whether they were now more likely to discuss the topics covered, as well as a few basic demographics. DATA COLLECTION In keeping with the participatory nature of this evaluation, all Interrelate Educators were asked to use the final versions of these evaluation forms with each MITTY group they conducted between mid-August and late-September 2010. Willing Educators distributed the Student and Teacher evaluation forms at the end of each program, usually for immediate completion although some forms were returned later (where groups had insufficient time during or after their last MITTY session). All completed surveys were then forwarded to the CCYP for logging, data entry, coding, cleaning and analyses. Page|7 EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: Moving Into The Teen Years DATA ANALYSES All survey data were entered and analysed using Microsoft Excel. Basic descriptive statistics (eg: means, counts and/or percentages) were calculated for each question asked across the various surveys. Two-sample t-tests were conducted to determine whether any statistically significant response differences existed between i) girls and boys or ii) younger and older students (10-11 year olds were compared with 12-13 year olds). These test results are presented only for those comparisons which reached statistical significance at p<0.05 or less, with smaller p values (which can range between 0 and 1) indicating larger differences between the groups being compared. Qualitative responses to open-ended questions were coded to determine the dominant themes emerging. The number of occurrences of each theme and sub-theme were then counted, with the overall results presented in this report. ETHICS This project was reviewed and approved by Southern Cross University‟s Human Research Ethics Committee (approval number: ECN-10-146), as well as being conducted in accordance with the CCYP‟s internally-developed Code of Ethical Practice for Working & Researching with Children & Young People. 8|Page CENTRE FOR CHILDREN & YOUNG PEOPLE, SOUTHERN CROSS UNIVERSITY RESULTS SAMPLE CHARACTERISTICS As detailed in the table below, this report is based on the evaluation forms collected from 56 MITTY groups delivered across 31 schools (see Appendix D for more detail of the schools involved). These groups were attended by 1541 students and 61 teachers, almost all of whom completed evaluation forms at the end of their MITTY program. MOVING INTO THE TEEN YEARS: EVALUATION PARTICIPANTS Schools 31 MITTY Groups 56 Students 1452 (94% of all 1541 attending) Teachers 61 (100% of all 61 attending) As shown in the table below, almost all participating students were aged 11 or 12 years old, with a fairly even split between females and males. About two-thirds of participating teachers were female and aged over 40 years. The vast majority of both students and teachers attended public schools, mostly in Interrelate‟s Sydney regions. Almost half the teachers had attended multiple previous MITTY groups but most others were attending for the first time. MOVING INTO THE TEEN YEARS: SAMPLE CHARACTERISTICS CHARACTERISTIC STUDENTS (N = 1452) Gender Age (Students) Age (Teachers) School Type Interrelate Region Any Previous MITTY attendances TEACHERS (N = 61) Female 52% 67% Male 48% 33% Mean & Range 11.5 years (range = 10-13) --- 11 years 51% --- 12 years 48% --- Under 30 years --- 13% 31-40 years --- 17% 41-50 years --- 28% 51+ years --- 42% Public School 88% 89% Anglican School 8% 7% Grammar School 4% 4% Sydney – Northern 32% 33% Sydney – Western 31% 30% Sydney – Southern 16% 9% Far North Coast 11% 11% Sydney – Eastern & Inner 5% 6% Illawarra, Southern Highlands & South Coast 5% 11% None --- 39% Been once before --- 13% Been multiple times --- 48% Page|9 EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: Moving Into The Teen Years PARTICIPANT FEEDBACK ABOUT THE MITTY PROGRAM STUDENT SATISFACTION As shown in the table below, students reported high levels of satisfaction with the MITTY program. In particular, the students found it enjoyable, interesting and good to have discussed in a group, although half also found it somewhat embarrassing. Very few students found it boring but one-third found some bits hard to understand. MOVING INTO THE TEEN YEARS: STUDENT SATISFACTION (N = 1452) QUESTION NO, NOT AT YES, A ALL / NOT MAYBE LITTLE/ YES, REALLY MEAN RATINGS (1= LOWEST, 5= HIGHEST) A LOT ALL BOYS GIRLS (N=685) (N=729) 10-11 YRS 12-13 YRS (N=727) (N=684) Did you enjoy this program – overall? 8% 13% 78% 4.05 4.15 3.96 3.97 4.15 It was interesting 9% 14% 77% 4.04 4.09 4.00 3.98 4.11 It was good talking about it in a group 12% 19% 69% 3.92 3.94 3.90 3.86 3.98 It was fun 18% 21% 60% 3.67 3.74 3.62 3.61 3.75 It was embarrassing 33% 17% 51% 3.26 3.16 3.38 3.31 3.23 Some bits were hard to understand 52% 19% 29% 2.61 2.63 2.60 2.63 2.60 It was boring 78% 14% 8% 1.85 1.84 1.84 1.86 1.81 Highlighted in the table above, there were some statistically significant differences between different age and gender sub-groups‟ mean ratings: Male students reported higher enjoyment levels than female students (t=3.7355, p<0.0005); Female students reported higher embarrassment levels than male students (t=3.2709, p<0.005); and Compared to their younger peers, older students reported higher enjoyment levels (t=3.5395, p<0.0005), found the program more interesting (t=2.4515, p<0.05), more fun (t=2.1800, p<0.05) and were more comfortable with the group approach (t=2.0090, p<0.05). The positive satisfaction ratings were supported by students’ written responses to a final openended question asking if there was anything else they wanted to say: 40% of students (n=577) offered positive feedback about the MITTY program and/or presenter, including: 20% (n=295) who commented about how helpful, educational or interesting they had found the program; 15% (n=214) who expressed their appreciation and/or congratulations for the program; 12% (n=175) who commented about having found the program an enjoyable experience; 5% (n=69) who particularly acknowledged the Educator’s delivery style; and 4% (n=51) who commented about the program’s importance and/or the need for it to continue. The following quotes are just a few examples of the many ways students expressed these positive reactions. 10 | P a g e CENTRE FOR CHILDREN & YOUNG PEOPLE, SOUTHERN CROSS UNIVERSITY THAT WAS AWESOME! It was extremely interesting in numerous ways. Moving into teen years was a great program and I learnt heaps more about the human body. It was very easy to understand what <Educator> said because she explained it very well. I had a great time learning all different types of things about how peoples body changes I think every boy and girl in year 6 should go to this program. It was good to learn in a group (with friends) with a teacher who got it, kinda. This program is very helpful and a great way to inform kids reality of life. Thanks for coming in. I think that you are good to come in and teach us about puberty and stuff! It really broke the ice between my parents and I by talking about it. it has been the best learning experience Ive ever had. I learned a lot of stuff It helps me realise what is happening to myself. Thankyou I think we all learnt something new and very important about our bodies. Thanks for everything I think its really brave of you to do this! Thank you so much I did learn a lot. I will aways remember all of this information. I loved it. I hope the service gets a lot of funding. It was great I learnt a lot about what is going to happen and I'm not scared anymore. Interrelate is an excellent program for primary children. I really enjoyed the program and it is a better and more sensible way to find out about our bodies rather than gossiping girls. That our teacher made it extremely less intimidating than I expected. It was enjoyable and fun. Some bits about 'risky business' got boring. But overall, I would rate it 9 1/2 out of 10. Thank you very much. Thank you for the lessons, they are very interesting and I feel safer now that I know what is coming up in my life. Thank you! Great lesson! Recommended to all Make the lessons longer cause there so fund. <Educator> need a promotion shes AWSOME. I really enjoyed it. Iearnt a lot and it’s a shame it wasn't longer. Growing up is not a embarrassing or sily journey and I have learnt lots. I feel a lot safer and I know a lot more. Puberty bingo is fun. I was happy I could get some answers to some really embarrassing questions. I really liked it. I didn’t know anything but after these lesson I know a lot. It was embarrising at first but then I got used to it and felt more comforatable. I think that you were awsome and I learnt a lot from you thanks. P a g e | 11 EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: Moving Into The Teen Years Usually in combination with some positive feedback, 6% of students (n=88) also voiced some concern about the MITTY program and/or suggested ways it may be improved, including: 4% (n=53) who found the program content embarrassing and/or somewhat more than they felt ready for or wanted more coverage of a particular topic; and 2% (n=36) who commented about specific activities or resources or the overall program approach. Interrelate was VERY factual but a little descriptive. As much as we all hate learning its better than our parents! It was interesting but uncomfortable with the boys and girls in the same room. Teacher didn't really answer some stuff we asked eg gay sex. It was really embarrassing when <Educator> started laughing when I made a mistake. I think what we learnt this term was way too advanced for Year 6 students. Please do not compare anything to fruit. I really enjoyed the program but most of the things we talked about I already knew. Stop talking in slow voices about how we are supposed to be grown up but you still talk like I talk to my 2 year sister. Even though they were disgusting I'm glad I did the lessons. I feel ready for teenage years now. the programs a bit, just a bit, actually, a lot GROSS!!! The dvd about the baby being born was a bit 'wow'. Confrunting, you could say I think they should explain babies before the dvd. I didn’t understand sum stuff but maybe that’s a good thing. TEACHER SATISFACTION As shown in the table below, teachers also reported very high levels of satisfaction with the MITTY program. In particular, the teachers found it enjoyable, interesting, engaging for their students, good value and good to have discussed in a group. Although one-third found the program somewhat embarrassing, very few thought it was too long or hard to understand and two-thirds felt it had refreshed their own understanding about the topics covered. MOVING INTO THE TEEN YEARS: TEACHER SATISFACTION (N = 61) QUESTION NO, NOT AT ALL / NOT REALLY MAYBE YES, A LITTLE/ YES, A LOT (1= LOWEST, 5= HIGHEST) Did you enjoy this program – overall? 0% 0% 100% 4.95 Did the program engage your students? 0% 2% 98% 4.92 It was interesting 0% 2% 98% 4.92 It was good value 0% 3% 97% 4.90 It was good talking about it in a group 2% 5% 93% 4.70 It refreshed my understanding about the topics 20% 11% 69% 3.85 It was embarrassing 59% 8% 33% 2.48 Some bits were hard to understand 92% 5% 3% 1.48 It was too long 92% 5% 3% 1.34 12 | P a g e MEAN RATING CENTRE FOR CHILDREN & YOUNG PEOPLE, SOUTHERN CROSS UNIVERSITY These very positive satisfaction ratings were supported by the teachers’ written responses to a final open-ended question asking if there was anything else they wanted to say, where 61% of teachers (n=37) offered positive feedback about the MITTY program and/or presenter, including (see Appendix E for teachers‟ full responses and how they were coded): 34% (n=21) who welcomed the program’s approach and or presentation style; 33% (n=20) who particularly acknowledged the Educator’s delivery style; 30% (n=18) who praised the program and/or particular content areas; and 11% (n=7) who expressed their appreciation and/or congratulations for the program. - <Educator> has proven to be an excellent presenter. We request her again for 2011. - <Educator>’s calm and informative manner is great for Year 6s. Very worthwhile. Thank you. - <Educator>’s rapport with the students was excellent due to the professional way in which she presents the program. - A clear and concise presentation. Students were engaged and were encouraged to ask excellent questions. - A valuable / essential program. Being a male, such discussions are very difficult. Specialist delivery is the answer. - A wonderfully presented course, no suggestions for improvement thank you. - Children were actively involved and willing to share ideas / experiences, they felt very comfortable to do this. - Fantastic program. Kids learnt a great deal. Thank you. - Hard job to do sometimes I bet! Thanks for coming along. - If students are curious this if the perfect forum to satisfy their curiosity. - It was a great idea. I loved how <Educators> were easy going about it and light hearted. - It was all fantastic. <Educator> is wonderful with the tricky questions and is great with chn. - Keep up the good work. - Maintained a confident approach, friendly and approachable by staff and students. An outstanding presentation by an outstanding teacher. - Moving into the Teen Years is an invaluable program. <Educator> presented the program beautifully. Her humour relaxed the children. - Terrific program for Year 6. I'm quite comfortable handling the topic. Thank you. - The audio visuals have been updated and the presentation is more professional. - The instructor was very well informed and professional (and approachable). - This is so valuable at a Yr 6 level as many of my students are going through puberty already and need the real information, not just the multitude of info they find on the net. - thoroughly enjoyed it. Usually in combination with some positive feedback, 8% of teachers (n=5) also voiced some concern about the MITTY program and/or suggested ways it may be improved: Could even start with Year 5. It would be good to have a more up-to -date video but understand the reasons it's not. It would be great to update the 'video'. Clothes etc of parents could be more current. Somethings were discussed that perhaps were not necessary. More time, so much to cover too little time. P a g e | 13 EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: Moving Into The Teen Years PERCEIVED LEARNINGS OVERVIEW OF STUDENT LEARNINGS As shown in the table below, almost all students found the MITTY program useful, with moderate-high levels of learning reported across the wide range of topics covered. Students felt they had learned most about keeping themselves safe, making good choices, how their bodies would change during puberty and how babies develop. Most students felt they may now discuss these topics more often with their family and, to a lesser extent, their friends but not so much with their teacher. MOVING INTO THE TEEN YEARS: STUDENT LEARNINGS (N = 1452) QUESTION NO, NOT AT ALL / NOT MAYBE REALLY MEAN RATINGS (1= LOWEST, 5= HIGHEST) YES, A LITTLE/ YES, A LOT ALL BOYS (N=685) GIRLS (N=729) 10-11 YRS 12-13 YRS (N=727) (N=684) Did you find the program useful – overall? 4% 10% 86% 4.36 4.36 4.37 4.35 4.38 Did you learn anything new about …? How to keep yourself safe 11% 11% 78% 4.16 4.09 4.23 4.13 4.19 Making good choices 10% 14% 76% 4.13 4.04 4.21 4.10 4.16 How bodies change during puberty 12% 10% 78% 4.09 4.12 4.08 4.11 4.09 How babies develop 10% 13% 77% 4.09 4.04 4.14 4.06 4.13 Girls’ bodies 13% 10% 77% 4.01 4.08 3.94 4.01 4.01 The different feelings you may have as your body changes 9% 17% 73% 3.97 3.96 3.98 3.96 3.98 How babies are made 16% 12% 72% 3.95 3.87 4.03 3.96 3.95 Boys’ bodies 16% 13% 71% 3.90 3.65 4.16 3.93 3.89 How we’re all unique individuals 14% 21% 65% 3.83 3.85 3.83 3.81 3.87 Menstruation (periods) 16% 18% 66% 3.77 3.73 3.82 3.80 3.74 Nocturnal emissions (wet dreams) 18% 20% 62% 3.67 3.66 3.69 3.70 3.64 21% 22% 56% 3.48 3.36 3.62 3.54 3.46 With your friends 36% 26% 38% 3.02 2.89 3.14 2.96 3.08 With your teacher 74% 18% 8% 1.93 1.89 1.98 1.90 1.96 Will you talk more about these things now? With your family While older and younger students’ responses were all similar, there were some statistically significantly different mean ratings between the two genders: Male students reported learning more about ‘Girls’ bodies’ (t=2.3999, p<0.05) while female students reported having learnt much more about ‘Boys’ bodies’ (t=8.4321, p<0.00001); Female students also reported learning more about ‘Making good choices’ (t=2.6862, p<0.01), ‘How babies are made’ (t=2.4242, p<0.05) and ‘How to keep yourself safe’ (t=2.3481, p<0.05); and Female students felt more likely to discuss the topics covered with their family (t=3.9386, p<0.0001) and their friends (t=3.8329, p<0.0001). 14 | P a g e CENTRE FOR CHILDREN & YOUNG PEOPLE, SOUTHERN CROSS UNIVERSITY These positive ratings were supported by students’ written responses, with 75% of students (n=1091) answering an open-ended question about ‘The best thing I learned was …’. While 13% (n=191) wrote simply that they had learned “lots” from attending the MITTY program, most comments highlighted specific, and often multiple, learnings, across the following five broad themes: puberty; reproduction; bodies and sexuality; self-related issues; and relationships. The following sections provide more detail about the comments made in relation to each of these major themes. LEARNINGS ABOUT PUBERTY Puberty was the most common major theme, being mentioned in 29% (n=417) of students’ responses about their ‘best learning’. Most of these comments (20%) mentioned ‘puberty’ or ‘changes’ in general, often with a focus on how the students now felt more prepared for and accepting of it. As illustrated in the quotes below, some students also mentioned more specific learnings about puberty, including about menstruation (4%), other physical changes (3%), mood swings (2%), erections (1%) and pimples (1%). How your feelings and body changes through puberty How our bodies develop and how to handle it. Same boys have wet dreams and got man boobs Things about girls puberty (Periods, discharge, breasts, nips etc.) That having mood changes is perfectly normal and that everyone changes I didn’t know tampons got so big. I feel safer now that I know what is coming up in my life. That a sign of blood on your undies means you're getting your periods. That girls are a lot more harder to understand How to cope with emotions and to understand what I'm going through. That boys also have it hard in puberty. I learnt lot's about how to cope with growing up. About periods and what age you go through puberty. I learnt a lot about myself and hope to know what will happen later in life. Not to hide erictions not to put ttothpaste on pimples That puberty is nothing to be embrassed about. About the girl peroid how it works why we have it and what to do about it. P a g e | 15 EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: Moving Into The Teen Years LEARNINGS ABOUT REPRODUCTION Reproduction was the second-most common major theme, being mentioned in 20% (n=284) of students’ responses about their ‘best learning’. As illustrated in the following quotes, most of these comments related to how babies are made (11%) and/or born (8%) or to more general pregnancy-related issues (2%). that you need a man and women to make a baby Sex wasn't the only way to have a baby and that babies wont hurt much. the responsibilities of parents and how hard it is to be a parent when your young . about how babies are born and develop in the mums tummy. About the baby getting out of the vagina. how sperm and eggs form a baby. how you get twins, triplets and if their fraternal or identical babys are gross when they first born. how pregnancy can effect you What the thing attached to the other side of the umbilical cord does and that it can be removed. I didn’t know how a baby was formed and how it kinda looked like an alien. How a baby can be so small or hairy when born. How babies come in different colours. How a baby can be born (the different ways) That having your period isn't so bad when you bring a life into the world. LEARNINGS ABOUT BODIES AND SEXUALITY Bodies and sexuality was the third-most common major theme, being mentioned in 17% (n=246) of students’ responses about their ‘best learning’. As illustrated in the following quotes, these learnings covered a wide range of issues in relation to male and female body parts and how they work (8%), how and when to have safe sex (5%) and the different types of sexuallytransmitted diseases (5%). The human body is very weird and amazing. Not to be silly about penis and volvars. How the body works in different ways and what they do and why. 16 | P a g e The man has hairs all over the body such as chest hair and arm hair. I learnt more about male/female body. You should always use deoderant that it is normal for 1 breast to grow faster than the other. Few!! I also learnt what scrotum means. girls have 3 openings CENTRE FOR CHILDREN & YOUNG PEOPLE, SOUTHERN CROSS UNIVERSITY to think before having secual intercourse so I don’t get sti's Having sex brings great resposibilities. The dangers of underage sex. That even with a condom on you can still catch HIV (AIDS) It was great to learn all the different stuff of how you do sex. how you have sex and how the penise has to be erect for sex. To wear protection if you don’t want a baby. That there's more to sex then I realised. you can get lice in areas (private) How dnagerous having sex can actually be if they have disease and don’t use a condom. SELF-RELATED LEARNINGS Self-related issues were the fourth-most common major theme, being mentioned in 16% (n=233) of students’ responses about their ‘best learning’. As illustrated in the following quotes, these learnings covered a wide range of issues in relation to self-responsibility (12%), selfesteem and understanding (3%), as well as it being ok to talk about the topics covered in the MITTY program (2%). I really liked the learning about many things because when I am older I can make better choises. That even if I've done something wrong I can always talk about it. It helped me understand who I am as an individual. About the Ripple effect. Also how making one bad dissision can end up being a bad life. I will make the right decisions in life and that everyone is special in there own way. I feel much safer and less awkward. I learned not to put myself down and I learned some self respect. What I can do to help myself and knowing that I'm in control of my life. how to handle different places that I didn’t want to be in such as an unsafe party ex. How peoples body so different, and you just have to be healthy it doesn’t matter how big you are. Your body parts belong to you and never to be pressured. That you do have choices and that you learn about things that are a bit risky. That I'm special. that it's not that embarrassing to talk to people about what we talked about in Interrelate. How to keep yourself safe, making good choices. The 3 steps to making a good decision. knowing that being a teenager isnt that scary and people can help. Everything comes with consiquences. P a g e | 17 EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: Moving Into The Teen Years LEARNINGS ABOUT RELATIONSHIPS Relationships was the final major theme, being mentioned in 2% (n=24) of students’ responses about their ‘best learning’. As illustrated in the following quotes, these learnings related to strategies for handling conflict or problems (1%), improved understanding about good and bad relationships (½%) and how to build and keep good relationships (½%). I learnt a lot about relationships and that these are responsibility in them because I am in a relationship I enjoyed learning about relation ships. How to handle the situation. It helped me understand who I am as an individual and how to maintain relationships. that whatever people say you can still do you can be friends with somebody different What to do about a boyfriend and about raping. That you need to think before you do anything that could harm people. How to deal with peer pressure It helped me understand how to maintain relationships. TEACHER LEARNINGS As shown in the table below, teachers also found the MITTY program very useful, particularly for boosting their confidence, capacity and comfort to discuss the topics covered with their students. Almost three-quarters of teachers now expected to talk more about the topics with their classes. MOVING INTO THE TEEN YEARS: TEACHER LEARNINGS (N = 61) QUESTION Did you find the program useful – overall? Has coming helped you with …? Feeling confident that you can answer questions on the topics Knowing how to raise the topics with your class Feeling comfortable discussing the topics with your class Where to find more information on these topics Will you now talk any more with your class about these things now? 18 | P a g e NO, NOT AT ALL / NOT REALLY MAYBE YES, A LITTLE/ YES, A LOT (1= LOWEST, 5= HIGHEST) 0% 2% 98% 4.93 10% 2% 88% 4.36 11% 7% 82% 4.20 11% 10% 79% 4.18 18% 18% 64% 3.80 11% 19% 70% 3.81 MEAN RATING CENTRE FOR CHILDREN & YOUNG PEOPLE, SOUTHERN CROSS UNIVERSITY These positive ratings were supported by 52% of teachers (n=32) writing responses about ‘The best thing I learned …’ (see Appendix E for teachers‟ full responses and coding): 23% (n=14) commented on having learned more about their students (eg: maturity, openness, point of view) from their reactions during the program; - How quirky things amuse then like twins or genetic traits are passed on. - It was fantastic to see the students so engaged and openly discussing these sensitive topics in a mature manner. - More about my students - how keen they are to share personal information. I feel the programs success is measured by student involvement / eagerness to be part of the lessons - all students were engaged and I feel it is largely due to <Educator>’s approachability / manner. - That boys ideas xxxx are ageless - That the students were mainly interested, yet quite horrified by the whole birthing process. - that this topic can be successfully taught using all technical language without students becoming over the topic. - The children in the class were surprisingly sensible and asked good questions - The reactions of the children. The differences - how various children coped in many ways. - The students are happy to ask questions in a group situation and talk a lot about it amongst themselves but talk very little about things with their parents. 16% (n=10) expressed some surprise at their students’ pre-existing knowledge levels of the topics covered; - Chn know a lot already! - How knowledgeable young children are about sexual topics. - How little my class knew about growing up and reproduction. - How much the odd members of the class did actually know already. Some prior knowledge of some of the students was surprising. - Students think they know a lot more than they do actually. Most questions students ask are in response to something they've seen on TV. 11% (n=7) felt better prepared or more confident to discuss the topics with their students; and - Different ways (How to) discuss sensitive topics with students transitioning into puberty. - How easy it was to talk about this topic with this age group, and this class group. - How to approach topics and how to respond to and answer any question thrown out there. Also how to make chn understand. - How to deliver this kind of information in a comfortable, trusting, unembarrassing environment to my students. 8% (n=5) felt they had gained some extra content knowledge from the program. - How to combine the anatomy, sexual and emotional feelings and thinking skills together. - STI's and how to treat, how spread etc. - Taking responsibility for your own choices. - What things can cause HIV. Especially in these days when tatoos etc are very popular but dangerous. P a g e | 19 EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: Moving Into The Teen Years REFERENCES Carmody M., Willis K. (2006) Developing Ethical Sexual Lives: Young People, Sex, and Sexual Assualt Prevention, NSW Rape Crisis Centre & SJSC Research Centre - University of Western Sydney, Sydney. de Winter M., Baerveldt C., Kooistra J. (1997) Enabling children: Participation as a new perspective on child-health promotion. Child: Care, Health & Development 25:15-25. Fetterman D.M., Wandersman A. (2005) Empowerment Evaluation: Principles in Practice Guildford Press, New York. Greene S., Hill M. (2005) Researching children's experience: methods and methodological issues, in: D. Hogan and S. Greene (Eds.), Researching children's experience : methods and approaches, Sage, London pp. 1-21. Johnson V. (2009) Rights through evaluation and understanding children‟s realities, in: B. Percy-Smith and N. Thomas (Eds.), A Handbook of Children and Young People's Participation: Perspectives from Theory and Practice, Routledge, Oxford. Kushner S. (2005) How does evaluation create options to enhance social justice? The Evaluation Exchange XI:18. Macbeth A., Weerakoon P., Sitharthan G. (2009) Pilot study of Australian school-based sexual health education: Parents' views. Sexual Health 6:328-333. Melville R. (2008) Token participation to engaged partnerships: Lessons learnt and challenges ahead for Australian not-for-profits, in: J. Barraket (Ed.), Strategic Issues for the Not-for-profit Sector, UNSW Press, Sydney. Millar P., Guenther J. (2007) Supporting and Capacity Building for our Partners, Australian Research Alliance for Children & Youth, Perth. Milton J. (2003) Primary school sex education programs: Views and experiences of teachers in four primary schools in Sydney, Australia. Sex Education 3:241-256. Mueller T., Gavin L., Kulkarni A. (2008) The association between sex education and youth's engagement in sexual intercourse, age at first intercourse, and birth control use at first sex. Journal of Adolescent Health 42:89-96. Muir K., Katz I., Purcal C., Patulny R., Flaxman S., Abello D., Cortis N., Thomson C., Oprea I., Wise S., Edwards B., Gray M., Hayes A. (2009) National Evaluation (2004-2008) of the Stronger Families and Communities Strategy 2004-2009 (FaCHSIA Occasional Paper No. 24), Australian Government, Canberra. Newell S., Graham A., Cashmore J. (2008) Evaluating community-based programs: Challenges & lessons from the front-line 10th Australian Institute of Family Studies Conference, Melbourne. Newell S., Britt W., Graham A. (2011a) Evaluating Interrelate's School Education Programs: Minding Me, Prepared for Interrelate Family Centres, Sydney. Newell S., Britt W., Graham A. (2011b) Evaluating Interrelate's School Education Programs: Where Did I Come From? and Preparing for Puberty, Prepared for Interrelate Family Centres, Sydney. Our Community. (2003) The Community Manifesto: Valuing Australia's Community Groups, Our Community Pty Ltd, Melbourne. Ryan P. (2003) "I'm looking at the future": Evaluation Report of Reconnect, Australian Government, Canberra. Schwandt T.A. (2007) Expanding the conversation on evaluation ethics. Evaluation & Program Planning 30:400-403. Schweigert F.J. (2007) The priority of justice: A framework approach to ethics in program evaluation. Evaluation & Program Planning 30:394-399. Tisdall E.K.M., Davis J.M., Prout A., Hill M. (2006) Children, Young People and Social Inclusion: Participation for What? Policy Press, Bristol. 20 | P a g e CENTRE FOR CHILDREN & YOUNG PEOPLE, SOUTHERN CROSS UNIVERSITY APPENDICES APPENDIX A: HOW MITTY CORRELATES TO THE NSW PD/H/PE SYLLABUS P a g e | 21 EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: Moving Into The Teen Years 22 | P a g e CENTRE FOR CHILDREN & YOUNG PEOPLE, SOUTHERN CROSS UNIVERSITY APPENDIX B: STUDENT EVALUATION FORM – MITTY PROGRAM P a g e | 23 EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: Moving Into The Teen Years APPENDIX C: TEACHER EVALUATION FORM – MITTY PROGRAM 24 | P a g e CENTRE FOR CHILDREN & YOUNG PEOPLE, SOUTHERN CROSS UNIVERSITY APPENDIX D: SCHOOLS INCLUDED IN EVALUATING THE MITTY PROGRAM REGION Far North Coast Illawarra, Southern Highlands & South Coast Sydney – Eastern & Inner Sydney – Northern Sydney – Southern Sydney – Western SCHOOL NUMBER OF CLASSES Byron Bay Public School 3 Clunes & Eureka Public Schools (combined) 1 Lennox Head Public School 2 Teven-Tintenbar Public School 1 Tregeagle & Rous Public Schools (combined) 1 Bowral Public School 2 Mt Terry Public School 3 Nowra Anglican College 1 Bellevue Hill Public School 2 Enfield Public School 1 Balgowlah North Public School 2 East Lindfield Public School 3 Killara Public School 1 Lane Cove Public School 3 Lane Cove West Public School 1 Lindfield Public School 2 Manly Vale Public School 1 Middle Harbour Public School 2 Warrawee Public School 2 Danebank Anglican School for Girls 2 Gymea Bay Public School 2 Menai Public School 1 Arndell Anglican College 2 Bankstown Grammar 2 Denistone East Public School 4 Eastwood Heights Public School 2 Kings Langley Public School 3 Thornleigh West Public School 2 Wilberforce Public School 2 P a g e | 25 EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: Moving Into The Teen Years APPENDIX E: CODING TEACHERS’ WRITTEN RESPONSES TO OPEN-ENDED QUESTIONS BEST LEARNINGS Q5 The best thing I learned was … This is my third time round so I haven’t learnt anything new but I believe it’s a fantastic program. N/a How to approach topics and how to respond to and answer any question thrown out there. Also how to make chn understand. How to deliver this kind of information in a comfortable, trusting, unembarrassing environment to my students. Q10 Program Content Personal Any other comments Nothing/ Easier to Body/ Changes/ safety/ Not discuss Sexuality- PubertyBehaviour or suggestions? Much with kids related related mgmt It would be good to have a more up-to -date video but understand the reasons it's not. About the Kids Criticisms/ Suggestions POSITIVE Comments Their reactions Their About About About About Thanks/ About maturity/ existing Program/ Approach/ Program/ Approach/ Appreciation Presenter openness / knowledge Content Presentation Content Presentation point of view 1 1 1 1 It was all fantastic. Lane is wonderful with the tricky questions and is great with chn. This is so valuable at a Yr 6 level as many of my students are going through puberty already and need the real information, not just the multitude of info they find on the net. how to relate material to students in thoroughly enjoyed it. a sensative manner The instructor was very well How to speak to the children about informed and professional the facts. (and approachable). How easy it was to talk about this More time, so much to cover topic with this age group, and this too little time. class group. Different ways (How to) discuss sensitive topics with students transitioning into puberty. How to raise embarrassing topics with the students. How to combine the anatomy, secual and emotional feelings and thinking skills together. What things can cause HIV. A wonderfully presented Especially in these days when course, no suggestions for tatoos etc are very popular but improvement thank you. dangerous. STI's and how to treat, how spread Keep up the good work. etc. 26 | P a g e General OTHER COMMENTS 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 CENTRE FOR CHILDREN & YOUNG PEOPLE, SOUTHERN CROSS UNIVERSITY BEST LEARNINGS Q5 The best thing I learned was … Q10 How little my class knew about growing up and reproduction. How quirky things amuse then like twins or genetic traits are passed on. More about my students - how knowledgeable they already are, and how keen they are to share personal information. I feel the programs success is measured b student involvement / eagerness to be part of the lessions - all students were engaged and I feel it is largely due to Lyndalls approachability / manner. The responses of the students to various parts of the items finding out what they know and their reactions. It was fantastic to see the students so engaged and openly discussing these sensitve topics in a mature manner. About the Kids Criticisms/ Suggestions POSITIVE Comments Their reactions Their About About About About Thanks/ About maturity/ existing Program/ Approach/ Program/ Approach/ Appreciation Presenter openness / knowledge Content Presentation Content Presentation point of view 1 Hard job to do sometimes I bet! Thanks for coming along. Thanks especially to Sally for her competent and relaxed approach to the unit. What a wonderfully engaging and informative program. Thank you! Terrific program for Year 6. I'm quite comfortable handling the topic. Thank you. That boys ideas xxxx are ageless Great job. Thank you. The students are happy to ask Tiffany is a fantastic questions in a group situation and presenter, the students talk a lot about it amongst really enjoyed the lessons themselves but talk very little about and asked lots of questions things with their parents. and learnt a lot. A clear and concise presentation. Students were More informatin about my students engaged and were encouraged to ask excellent questions. The reactions of the children. The differences - how various children coped in many ways. Program Content Personal Any other comments Nothing/ Easier to Body/ Changes/ safety/ Not discuss Sexuality- PubertyBehaviour or suggestions? Much with kids related related mgmt The differences that the boys and girls have and each of the concerns. Taking responsibility for your own choices. General OTHER COMMENTS 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 P a g e | 27 EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: Moving Into The Teen Years BEST LEARNINGS Q5 The best thing I learned was … Q10 28 | P a g e Program Content Personal Any other comments Nothing/ Easier to Body/ Changes/ safety/ Not discuss Sexuality- PubertyBehaviour or suggestions? Much with kids related related mgmt A valuable / essential program. Being a male, such discussions are very difficult. Specialist delivery is the answer. Greater understanding of individual If students are curious this if students maturity, presaredness for the perfect forum to satisfy puberty. their curiosity. The children in the class were surprisingly sensible and asked Tiffany has a lovely manner! good questions that this topic can be successfully taught using all technical language without students becoming over the topic. That the students were mainly interested, yet quite horrified by the whole birthing process. Sally's calm and informative Chn know a lot already! manner is great for Year 6s. Very worthwhile. Thank you. It was a great idea. I loved I think to be up front with the how Sally and Pat were easy students. The steps of a baby. going about it and light hearted. How knowledgeable young children The presenter, Pat ws very are about sexual topics. informative and excellent. How much the odd members of the Pat has proven to be an class did actually know already. excellent presenter. Some prior knowledge of some of Thornleigh West PS request the students was surprising. her again for 2011. The high standard of students entering knowledge and awareness. How much some of our stage 3 students alrady knew. Students think they know a lot more than they do actually. Most questions students ask are in response to something they've seen on TV. That my students could listen / interact as sensibly as they did. General OTHER COMMENTS About the Kids Criticisms/ Suggestions POSITIVE Comments Their reactions Their About About About About Thanks/ About maturity/ existing Program/ Approach/ Program/ Approach/ Appreciation Presenter openness / knowledge Content Presentation Content Presentation point of view 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 CENTRE FOR CHILDREN & YOUNG PEOPLE, SOUTHERN CROSS UNIVERSITY BEST LEARNINGS Q5 The best thing I learned was … were Sallys great responses to the children's questions. Q10 General Program Content Personal Any other comments Nothing/ Easier to Body/ Changes/ safety/ Not discuss Sexuality- PubertyBehaviour or suggestions? Much with kids related related mgmt Fantastic program. Kids learnt a great deal. Thank you. Moving into the Teen Years is an invaluable program. Pat presented the program beautifully. Her humour realxed the children. Lane is a great presenter. Really engages the chn. It is a great program. Great program! Could even start with Year 5 Maintained a confident approach, friendly and approachable by staff and students. An outstanding presentation by an outstanding teacher. Tiffany's rapport with the students was excellent due to the professional way in which she presents the program. Our presenter spoke very confidently, but calmly, and handled the embarrassing moments very well. Maha presented the information in an engaging and informative manner. She was great! The topics covered were delivered by a trained educator. OTHER COMMENTS About the Kids Criticisms/ Suggestions POSITIVE Comments Their reactions Their About About About About Thanks/ About maturity/ existing Program/ Approach/ Program/ Approach/ Appreciation Presenter openness / knowledge Content Presentation Content Presentation point of view 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 Sally was very knowledgeable and professional. Sally ia very patient. It would be great to update The way in which the knowledge the 'vidoe'. Clothes etc of and understandings are presented. parents could be more current. 1 1 1 1 P a g e | 29 EVALUATING INTERRELATE’S SCHOOL EDUCATION PROGRAMS: Moving Into The Teen Years BEST LEARNINGS Q5 The best thing I learned was … Q10 Program Content Personal Any other comments Nothing/ Easier to Body/ Changes/ safety/ Not discuss Sexuality- PubertyBehaviour or suggestions? Much with kids related related mgmt The audio visuals have been updated and the presentation is more professional. It's important to be upfront and honest when talking about these issues to students. They have a right to know the information. About the Kids Criticisms/ Suggestions POSITIVE Comments Their reactions Their About About About About Thanks/ About maturity/ existing Program/ Approach/ Program/ Approach/ Appreciation Presenter openness / knowledge Content Presentation Content Presentation point of view 1 1 Somethings were discussed that perhaps were not necessary. 30 | P a g e General OTHER COMMENTS 1 Centre for Children and Young People Southern Cross University PO Box 157 Lismore NSW 2480 Phone 02 6620 3605 Fax 02 6620 3243 Email: ccyp@scu.edu.au www.ccyp.scu.edu.au
Similar documents
Evaluating Interrelate`s School Education Programs
Although based on post-only surveys (for pragmatic reasons), the consistency of and concordance between participants’ ratings and written comments enhance our confidence in the validity of the find...
More information