The YouthNow BizE Centre Evaluation 2014

The YouthNow BizE Centre Evaluation 2014

 Dr Shanti Wong Ian Wong Colleen Bergin Dr Megan Wong Ilona Lomnicki Acknowledgements This evaluation was prepared by Dr Shanti Wong and Ian Wong, Starfish Consultancy. Research support was provided by Dr Megan Wong, Starfish Consultancy and Ilona Lomnicki, Community Development student at Victoria University. The video case study was produced by Mark Wardle, Gingko Media. The authors would also like to acknowledge the support and contribution made by Colleen Bergin, YouthNow Executive Officer and the assistance provided by the staff of YouthNow. Thank you to the following for participating in interviews, consultations and surveys. • YouthNow Executive Officer, Colleen Bergin •
YouthNow Board Chair, Craig Rowley •
YouthNow staff •
BizE Centre trainees •
Representatives of YouthNow partners at the BizE Centre launch, December 2013. This evaluation was funded by the Adult Community and Further Education (ACFE) Board under the Capacity and Innovation Fund 2012. Citing this report: Please cite this report as: Wong, S., Wong, I., Bergin, C., Wong, M., & Lomnicki, I., 2014, YouthNow BizE Centre Evaluation 2014, YouthNow, Sunshine, Victoria. This report, YouthNow BizE Centre Evaluation 2014, is accompanied by YouthNow BizE Centre Evaluation 2014 -­‐ Scan of the Literature. YouthNow BizE Centre Evaluation 2014 2 Table of Contents Executive Summary ...................................................................................................... 4 Part 1. Evaluation of the YouthNow BizE Centre ................................................ 6 Background .................................................................................................................................. 6 The BizE Centre model ...................................................................................................... 6 Objective of the evaluation .............................................................................................. 7 Methodology ............................................................................................................................... 8 Interviews ............................................................................................................................... 8 Key Findings ................................................................................................................................ 9 The BizE Centre as a model of youth engagement ............................................... 11 Project Performance – against Outcomes ................................................................ 12 Project Performance against Objectives .................................................................. 13 Main Benefits of the Program ....................................................................................... 15 In summary ................................................................................................................................ 17 Challenges and learnings ................................................................................................ 18 Recommendations ............................................................................................................. 18 Conclusion ............................................................................................................................. 19 Appendices .................................................................................................................... 20 Appendix 1: BizE Centre Evaluation Framework ..................................................... 20 Appendix 2: BizE Centre Participant Entry Survey .................................................. 21 Appendix 3: BizE Centre Participant Exit Survey ..................................................... 24 Appendix 4: YouthNow Staff Survey ............................................................................... 27 YouthNow BizE Centre Evaluation 2014 3 Executive Summary ‘...I have learnt new computer skills, gained experience in administration tasks and communication skills. also I have gained new friends’ (BizE Centre trainee, exit survey 2014). Project Purpose The YouthNow BizE Centre provides early school leavers and disengaged youth with a workplace model integrating career development, employability skills training and real work. The model allows rolling intake of youth into a work environment where employability skills are given context, peer supporters and work mentors give guidance, flexible learning approaches satisfy the needs of individuals and where pre-­‐accredited courses are seamlessly commenced and completed as on the job training. At the BizE Centre, youth are supported to develop their identity and social capitals through working within boundaries of normal employment conditions, whilst being guided through career options, investigating industry opportunities and moving on to certificate courses and/or employment. Rationale Brimbank is a western suburbs region of Melbourne characterised by a high multi cultural youth population many of whom experience multiple barriers to successful life outcomes. Compared to the rest of the state Brimbank experiences significant levels of school disengagement, high youth unemployment (15%) and socio economic disadvantage. As a member of the Brimbank Youth Sector Leaders Group (BYSLG), which seeks to galvanise a cross-­‐sectoral approach to decrease youth disadvantage in the area, particularly in educational attainment and employment outcomes, YouthNow seeks to develop a sustainable training initiative that complements the strategic intent of the BYSLG and leads to education and employment outcomes for young people. Summary of Key Findings The YouthNow BizE Centre program is designed on good practice principles, incorporating key strategies identified in the literature: • It has been created through a strong and well-­‐planned business model based on effective partnerships and is locally designed and targeted to reflect the requirements of the community • The use of the resources of YouthNow and its educational and industry partnerships enables the program to engage its target client group of young people who face barriers to employment • Embedding it within the broader YouthNow business ensures that it retains accountability and contributes to the organisation’s growth and sustainability YouthNow BizE Centre Evaluation 2014 4 • Most importantly, the BizE Centre contributes to achieving successful transitions and pathways for the trainees, fulfilling its mission ‘To empower young people to have self worth and encourage the will to learn, plan, and improve through the acquisition of relevant tools, knowledge, and skills’. 1 • It is an example of a successful community partnership -­‐ that is, one that is long term, evolves over time and enables YouthNow to build the necessary collaboration and resources capability. Outcomes Outcome expected: Participation increased from 9 (2012) to 15 trainees at any one time. Result: 10 trainees participated. The delay in facility upgrade limited the number of trainees in the early part of the year, but numbers were increased once the BizE Centre was available. Outcome expected: Increased completion: 90% of trainees complete the training. Result: 100% completion. Outcome expected: Increased employability skills. Result: initial employability skills assessment completed. Outcome expected: Education, training or employment destination for each trainee. Result: Four trainees have enrolled in Accredited courses next year. Two of these also have part-­‐time employment. Another trainee is undertaking a personal development program with a private RTO. Three trainees have returned to the BizE Centre for next level of training. The ninth trainee is planning to return to study but has not made a decision about his course yet. Outcome expected: Model of youth reengagement documented and evaluated as successful. Result: Evidenced by this report, with specific features of the model described. Outcome expected: Model of BizE Centre as social enterprise explored. Result: A successful application has been made by YouthNow to be part of the Social Traders, The Crunch in 2014. The Crunch is Social Traders’ highly successful initiative for early stage social enterprises aiming to receive investment and start trading within 12 months. 1 www.youthnow.org.au YouthNow BizE Centre Evaluation 2014 5 Part 1. Evaluation of the YouthNow BizE Centre Background The BizE Centre model YouthNow received funds from the Adult Community and Further Education (ACFE) Board under the Capacity and Innovation Fund 2012 to pilot and evaluate the BizE Centre model in 2013. The project aimed to demonstrate capacity under the ACFE ‘Innovating for Learners’ Assessment Criteria as follows: The targeted learner cohorts were early school leavers, and disengaged youth. These cohorts include15 to 25 year olds, and may include young people with disabilities (including mental health issues), young people from CALD backgrounds and/or refugees and newly arrived, indigenous youth, and young people transitioning through the justice system. The project aimed to provide a re-­‐engagement model utilising 16 of the 17 strategies described by Davies Lamb Doecke (Aug 2011)2 in the Department of Education and Early Childhood Development’s (DEECD) research as indicators of the most effective youth re-­‐engagement programs. YouthNow’s strength in industry engagement, career development and pathways support would strengthen the program further addressing the learner’s needs and delivering destination outcomes which will be measured throughout the project. The project also aimed to demonstrate innovation and focus on Vocational Education and Training (VET) pathways by integrating the youth cohort into the organisation and structure of the YouthNow business, with trainees (learners) and staff working alongside one another. All YouthNow Staff have support, mentoring, supervisory or colleague roles and responsibilities with the trainees. Trainees experience the workplace culture and environment, following the same working conditions, code of practice, and policies and procedures while they develop career pathway plans. Course components (Career planning, industry investigation, financial and work literacy, numeracy, civics, employability) are integrated into the work day through flexible on the job delivery and are hands on in the context of work. not a classroom -­‐ a workplace; not a student -­‐ a trainee; not a tutor – a supervisor; not a timetable -­‐ an electronic calendar; not a course -­‐ a transition pathway into vocational education and training and/or employment. 2
Davies, M., Lamb, P. S., & Doecke, E. (2011). Strategic Review of Effective Re-Engagement Models
for Disengaged Learners. Melbourne, Australia: State of Victoria. Department of Education and
Early Childhood Development.
YouthNow BizE Centre Evaluation 2014 6 The project aimed to support improvement in learner participation and attainment by designing activities around DEECD’s effective models of re-­‐engaging young people, utilising the strength of YouthNow’s career development expertise and partnerships with local businesses. Improvement in learner participation and attainment would come thorough preparation, rigorous evaluation and a very strong career support program. Whilst young people appreciate flexible delivery they also want structure and purpose in what they do. Poor planning leads to lower participation and attainment. On the job training and work experience activities with local businesses provide incentive and purpose. Mentoring and peer support provide a sounding board and a helping hand when things get tough. YouthNow referrals to certificate courses would be carefully considered and planned in the individual’s career pathway plan reducing the risk of learners dropping out. Participation rates were measured through follow up destination and pathway surveys of YouthNow Graduates.3 Objective of the evaluation The purpose of the evaluation is to determine and articulate the effectiveness of the BizE Centre model in improving the VET participation and attainment of early school leavers and disengaged young people. Evaluation questions: • What is the unique role of the BizE Centre in providing training and career development support for early school leavers and disengaged young people? • What are the outcomes for young people as a result of their participation in the BizE Centre? • How does YouthNow use the community partnership support and knowledge they bring to improve the outcomes for the BizE Centre trainees? 3 YouthNow Application to the ACFE Board Capacity and Innovation Fund 2012. YouthNow BizE Centre Evaluation 2014 7 Methodology 1. Preparation – scoping the evaluation and development of the evaluation framework in consultation with the Executive Officer of YouthNow. The agreed evaluation framework is shown as Appendix 1 2. The following streams of data gathering: a. Scan of the Literature (available as a separate report) b. Analysis of key documents c. Interviews with: § Executive Officer of YouthNow § Chair of the YouthNow Board § Representatives of YouthNow partners at the BizE Centre launch, December 2013. d. Video interviews with: § Executive Officer of YouthNow § Three BizE Centre trainees § BizE Centre Youth Worker on placement. e. Online survey of BizE Centre trainees at entry (Appendix 2) f. Online survey of BizE Centre trainees at exit (Appendix 3) g. Online survey of YouthNow staff (Appendix 4) h. Online survey of potential employers i. Analysis of trainee exit survey data, YouthNow staff survey data and trainee destination and outcome data. 3. Discussion of the findings from the various streams of data gathering in the Key Findings. Interviews The following individual interviews were held: • The Executive Officer of YouthNow •
Chair of the Board of YouthNow •
Wesley Program Program Leader (BizE Centre partner) Online surveys were conducted with: • BizE Centre trainees (9) •
YouthNow staff (7) YouthNow BizE Centre Evaluation 2014 8 Key Findings The YouthNow BizE Centre program is designed on good practice principles, incorporating key strategies identified in the literature. In particular, it has been created through a strong and well-­‐planned business model based on effective partnerships and is locally designed and targeted to reflect the requirements of the community. The resources of YouthNow – its people and its infrastructure and its educational and industry partnerships -­‐ enable the program to engage its target client group of young people who face barriers to employment. Embedding the BizE Centre within the broader YouthNow business ensures that it retains accountability and contributes to the organisation’s growth and sustainability. Most importantly, the BizE Centre contributes to achieving successful transitions and pathways for the trainees, fulfilling its mission ‘To empower young people to have self worth and encourage the will to learn, plan, and improve through the acquisition of relevant tools, knowledge, and skills’ 4 It is an example of a successful community partnership -­‐ that is, one that is long term, evolves over time and enables YouthNow to build the necessary collaboration and resources capability. 4 www.youthnow.org.au YouthNow BizE Centre Evaluation 2014 9 The core elements of the BizE Centre are: • To assist early school leavers and disengaged youth to transition onto career pathways and into employment • provide rolling intake of appropriate pre-­‐accredited courses for trainees for early school leavers and disengaged young people with flexible completion dates to accommodate individual learners • develop work oriented flexibly delivered curriculum which includes civics, financial literacy, digital literacy, work literacy and numeracy, employability skills, industry investigation and careers planning • To provide a work environment where youth are exposed to, develop an understanding of and have extended experience in employment/work conditions and culture (YouthNow BizE Centre Marketing Flyer 2012). BizE Centre trainees interviewed agreed with these core elements and broke them down further: ‘You have been so supportive and patient.’ ‘I gained a new appreciation for life, and learnt more about myself as a person.’ ‘I learnt how to fill in key selection criteria (for applications), gained self confidence, and improved in my people skills.’ ‘It was great having something to do and having new experiences.’ YouthNow BizE Centre Evaluation 2014 10 The BizE Centre as a model of youth engagement The BizE centre breaks new ground as a business and training model. The surveys and interviews identified the following factors that, collectively, make the program unique: • The YouthNow BizE Centre provides early school leavers and disengaged youth with a workplace model integrating career development, employability skills training and real work • The model allows rolling intake of youth into a work environment where employability skills are given context, peer supporters and work mentors give guidance, flexible learning approaches satisfy the needs of individuals and where pre-­‐accredited courses are seamlessly commenced and completed as on the job training • Trainees are supported to develop their identity through working within boundaries of normal employment conditions, whilst being guided through career options, investigating industry opportunities and moving on to certificate courses and/or employment • Pre-­‐accredited courses (such as Career planning, industry investigation, financial, digital and work literacy, numeracy, civics, employability, and customer service) are integrated into the work day through flexible on the job delivery and are hands on in the context of work • The level of community engagement provided by YouthNow supports the intention of the BizE Centre. In particular, the YouthNow partnerships which have provided a rich resource for establishing the workspace as a high quality office, recruiting mentors and future employers, providing additional support to trainees where required (for issues such as mental health and housing ), recruiting additional support in the form of VU students on placement. ‘It’s not a classroom – it’s a workplace; not a student -­‐ a trainee; not a tutor – a supervisor; not a timetable -­‐ an electronic calendar; not a course -­‐ a transition pathway into vocational education and training and/or employment’ (YouthNow BizE Centre Marketing Flyer 2012 ). ‘The learning environment is supportive, inclusive positive and respectful.’ 5 5 YouthNow (2013) staff survey YouthNow BizE Centre Evaluation 2014 11 Project Performance – against Outcomes Outcome expected: Participation increased from 9 (2012) to 15 trainees at any one time. Result: 10 trainees participated. As noted elsewhere, the delay in facility upgrade limited the number of trainees in the early part of the year, but numbers were increased once the BizE Centre was available. Outcome expected: Increased completion: 90% of trainees complete the training Result: 100% completion. Outcome expected: Increased employability skills. Result: initial employability skills assessment completed. Outcome expected: Education, training or employment destination for each trainee. Result: Four trainees have enrolled in Accredited courses next year. Two of these also have part-­‐time employment. Another trainee is undertaking a personal development program with a private RTO. Three trainees have returned to the BizE Centre for next level of training and being part of the social enterprise. The ninth trainee is planning to return to study but has not made a decision about his course yet. Outcome expected: Model of youth reengagement documented and evaluated as successful. Result: This report, with specific features of the model described above. Outcome expected: Model of BizE Centre as social enterprise explored. Result: As noted elsewhere, successful application has been made by YouthNow to be part of the Social Traders, The Crunch in 2014. The Crunch is Social Traders’ highly successful initiative for early stage social enterprises aiming to receive investment and start trading within 12 months. Anecdotally, YouthNow reports that trainees are getting a better range employment options than previously (BizE Centre launch -­‐ trainee presentation, 4 Dec 2013). An online survey at entry and exit has been designed and has been completed by trainees. All the current trainees completed it and rated the BizE Centre highly. They also noted how the YouthNow trainers had assisted them in a range of ways, including helping with job readiness skills such as resume preparation, and interview skills. YouthNow BizE Centre Evaluation 2014 12 Project Performance against Objectives 1. To pilot a model of on the job learning for early school leavers and disengaged youth to transition onto career pathways and into employment. The model has successfully embarked on all of the features described in the following points, integrating career development, employability skills training and real work. Some aspects are more developed than others – the workspace has been upgraded so that it is now a model office, recruitment of the trainees took some time but the numbers are increasing, the rolling intake is operational and the curriculum is being delivered. It has also taken time to generate sufficient work for the trainees to do. The bank of ‘next employers’ have yet to be sufficiently engaged although they have been consulted. Similarly, recruiting work from external employers to be undertaken by the BizE Centre is yet to be implemented. The partnerships YouthNow has with local businesses should provide a strong platform for this to occur in the next 12 months. 2. To provide rolling intake of appropriate pre-­‐accredited courses for early school leavers and disengaged young people with flexible completion dates to accommodate individual learners. The rolling intake of trainees has resulted in them entering a work environment where employability skills are given context, peer supporters and work mentors give guidance and flexible learning approaches satisfy their needs as individuals. As a result, some of the trainees have completed their training and are entering employment elsewhere, some are continuing their employment at the BizE Centre and some are continuing their training next year. 3. To develop work oriented flexibly delivered curriculum which includes civics, financial literacy, digital literacy, work literacy and numeracy, employability skills, industry investigation and careers planning. While at the BizE Centre the students carried out work activities and training on Work Place Literacy, Language and Numeracy including the following: • Employability Skills • Civics • Customer Service • Digital Literacy • Financial Literacy • Industry Exploration. YouthNow BizE Centre Evaluation 2014 13 4. To support youth to build their identity and social capitals. The desk-­‐top analysis of the project documents, the surveys, video case study interviews and the by the trainees at the launch of the BizE Centre indicate that their employment in the BizE Centre has been designed in accordance with best practice as identified in the literature and has contributed to their sense of worth. The mentoring process is well underway and trainees indicate the broader benefits that have come from this strategy. YouthNow also took community development and youth work students from VU on placement and these students worked alongside the trainees to assist them in all aspects of their time in the BizE Centre, providing support, technical and practical assistance, encouragement and assistance with problem solving and communication skills. YouthNow staff have observed that ‘now the clients have been coming for a while, they now seem to feel more relaxed and are not as shy as when they first started.’ The trainees were also ‘improving in business etiquette and building up confidence in their skills.’ 5. To provide a work environment where youth are exposed to, develop an understanding of and have extended experience in employment/work conditions and culture. While the BizE Centre was officially launched on 4 December 2013, the workspace has been allocated within the existing offices of YouthNow since the start of the project. That the trainees as additional workers have been successfully integrated into the YouthNow work environment is a testament to the cooperation and skills of the YouthNow staff and the leadership of the Executive Officer and the Board. Responses to the YouthNow Staff Survey indicated that it has been a positive experience, although some found it challenging in the beginning. ‘Overall, it has been rewarding working with the trainees.’ Strategies that have assisted in developing this successful model of on-­‐the-­‐job training include the ‘clear guidelines and routine to the day,’ ‘The supervision is very good.’ 6. To embed rigorous evaluation into the project so that the benefits can be articulated beyond anecdotal evidence. Starfish Consultancy was engaged as the evaluator at the outset of the project and has conducted a process evaluation throughout the year as well as this summative evaluation. The project findings from the Scan of the Literature, the desk top analysis of project documentation, the surveys, interviews and video case studies were incorporated into regular reports to the YouthNow Board and staff so that adjustments could be made as required. Follow-­‐through of the findings as they emerged was assisted by Starfish Consultancy also preparing the ACFE Interim Report, preparing material for subsequent submissions for funding and presenting on the findings at the launch of the BizE Centre. Further demonstrating YouthNow’s experience and commitment to ongoing evaluation, the trainees themselves have presented on the benefits through their own presentation at the launch of the BizE Centre and this strategy can be used to recruit future employers. YouthNow BizE Centre Evaluation 2014 14 7. To develop a model that can grow into a social enterprise that will allow the model to be self sustaining. The model is being documented both in this report and in a video case study and the findings have been used for the successful submission by YouthNow to Social Traders, The Crunch in 2014. The Crunch is Social Traders’ highly successful initiative for early stage social enterprises aiming to receive investment and start trading within 12 months. YouthNow has also received a Community Strengthening Grant from Brimbank City Council to deliver the 'YouthNow Community Volunteer & Mentoring Program' in 2014. This will help promote community leadership, encouraging community involvement and developing a stronger sense of belonging in the local community through the program. The Board is committed to making the BizE Centre the core of its sustainable future. Main Benefits of the Program The Executive Officer and Chair of the Board of YouthNow, 9 BizE Centre trainees and 7 YouthNow staff answered questions about the main benefits of the program: YouthNow Executive Officer and Board Chair: These senior representatives of YouthNow agreed that the main benefit is to the young person. Having a supportive ‘first employer’ is very beneficial to the young person who has faced barriers to educational attainment and employment. By embedding the BizE Centre in the daily operation of YouthNow, there are links, relationships and dynamics that occur through time. It is a smoothing of the path from school to training and/or employment, including assistance with the wider aspects of the young person’s life that may be contributing to their circumstances. Already after its first year, the outcomes demonstrate that there is evidence of student educational attainment and successful transition to employment beyond the BizE Centre. The Board is cognisant of the task ahead of the BizE Centre which, as an innovative approach to vocational skill development, is treading on new ground in the way it prepares the trainees. ‘The Board and the Executive Officer need to have conversations about the culture tightening up just a little bit so that the trainee is sufficiently resilient when they leave and enter a more usual world of work…that will also be important for the reputation of BizE Centre graduates so that they don't provide excuses for employers not to take them on.’ (YouthNow Board Chair, interview Dec 2013). YouthNow BizE Centre Evaluation 2014 15 BizE Centre trainees: 10 trainees participated in 2013 with 100% completion rate. The trainees agreed that the BizE Centre helped them gain experience in business administration and improved their employability skills. They valued being treated as a member of the team and having ‘our own desk, laptop, name tag, email account and even a drawer with stationery…’ (BizE Centre launch -­‐ trainee presentation, 4 Dec 2013). ‘During my time coming to the BizE Centre I have had the opportunity to meet some very interesting people. Some of which I have had the chance to work with them on there. The skills I have gained.’ (BizE Centre launch -­‐ trainee presentation, 4 Dec 2013). ‘...I have learnt new computer skills, gained experience in administration tasks and communication skills. also I have gained new friends.’ (BizE Centre trainee – exit survey 2014). ‘While coming to the BizE Centre I have brushed up on my Business Administration skills and Receptionist skills. To further this there was some Word processing and presentation experience.’ (BizE Centre trainee interview for video case study, Oct 2013). YouthNow BizE Centre Evaluation 2014 16 YouthNow staff: The staff all agreed that the BizE Centre provided an opportunity for young people to get into a work routine. The model allows the trainees to ‘meet new people and learn skills in a highly supportive manner.’ ‘ They are able to develop confidence in new situations‘ (YouthNow staff survey 2013). It is also apparent that the YouthNow staff have developed a particular set of skills and an approach that is able to integrate the trainees into their workplace and support their vocational and personal development at the same time. The YouthNow staff survey indicated that they recognised these qualities in other members of their team: ‘Everyone in the office tries to give them work to do and encourages them.’ ‘The staff do not give up on them even when the student is having a bad day.’ ‘(Staff member's) patience and encouragement is phenomenal.’ ‘(Staff member) has been wonderful in finding the time to get more curriculum organised.’ The staff did indicate that there were some concerns about the structure of the day for trainees, the time required to adapt training programs for this client group and the clarity of pathway plans and processes and whether the necessary partnerships were in place for this. However, the overall sentiment was one of support and enthusiasm for the BizE Centre model. In summary The BizE Centre rolls out YouthNow’s idea voiced at the NW Learn Local Business Capacity Program (June 2012). Discussions with Learn Local Providers and formalising the idea through the “Improvement Idea” activity during the program led to YouthNow’s plans to set up the work-­‐based learning BizE Centre. The BizE Centre builds YouthNow’s capacity for rolling intake, flexible delivery and for partnerships with organisations to refer clients into YouthNow programs and for YouthNow to refer learners onto their programs. The BizE Centre also has the capacity to develop as a social enterprise providing business services to local organisations and businesses while young people are training in the Centre, making the program self sustaining. YouthNow has delivered the project and benefited from building capacity, collaborating with partner organisations and learning from the program evaluation. YouthNow BizE Centre Evaluation 2014 17 Challenges and learnings The delay in setting up the actual workspace of the BizE Centre meant that recruitment of trainees was also delayed, as the existing space was inadequate for more than a couple of extra people at a time. However, it was beneficial to iron out the teething problems with a small number of trainees and when the BizE Centre was fully operational, it provided a quality training and working environment. The delayed start also enabled the YouthNow staff to become familiar with the idea of the model and adjust to it over time. The recruitment of the next stage of employers has been slower than expected and the engagement of them as clients for the BizE Centre has also not been implemented. The attention required to do this effectively will be available in 2014 as the BizE Centre operation is now bedded down and the intention in the project proposal will be realised – ie: ‘Local employers and businesses will be involved through work experience, site visits, and sponsorship of trainees. Employers will benefit through trainees completing tasks for them and having access to a pool of trainees for entry level positions.’ Recommendations 1. That the BizE Centre continues to operate along the lines of the current model in 2014 with the following enhancements: 2. That any new YouthNow staff are fully briefed about the BizE Centre and their role prior to commencement. 3. That the Board considers the next steps for the BizE Centre as a key component of its strategic intent to become financially self-­‐sufficient. Within this, the Board works with the YouthNow management to consider the changes the BizE Centre project needs to make to ensure it develops a reputation as a supplier of quality services and quality employees who are competitive in the open youth labour market. 3. That the evaluation methodology is embedded in the everyday operation of the BizE Centre. Specifically: Trainee surveys • All new trainees complete the entry survey on enrolment • All trainees complete the exit survey prior to leaving the program • Responsibility for administering, analysing and reporting on the survey results is allocated to a staff member. YouthNow BizE Centre Evaluation 2014 18 Trainee outcomes • Trainee pathway processes and options are strengthened and expanded to assist trainees into achieving successful post-­‐program placement • Destination data is routinely recorded, analysed and reported on. 4. That the recruitment of ‘next employers’ is a focus for 2014 with targets set and monitored. 5. That the recruitment of business for the BizE Centre is a focus for 2014 with targets set and monitored. Conclusion The BizE Centre is integral to the sustainable development of YouthNow and is highly valued by the Board. YouthNow staff are very supportive of the idea of the BizE Centre. They have found contact with the trainees to be challenging and rewarding. Staff have also noted significant growth in the trainees. Unique features of the BizE Centre model are that young people are a part of the team and they learn at their own pace. Tasks are seen as relevant to the organisation and useful. Further work experience and access to careers support is also regarded as a positive aspect of the project. Parent involvement has been good. The mentors provide a further network or support and much needed conversational skills that are not otherwise exercised when focused on completing tasks. ‘The BizE Centre is challenging but also exciting -­‐ at times I feel I am out of my depth but I do enjoy what it brings to the clients. Just learning a new skill is so thrilling -­‐ to see their reaction once they have understood and know how to do the set task is a joy to watch and be a part of it.’ (YouthNow Staff Survey 2013). YouthNow BizE Centre Evaluation 2014 19 Appendices Appendix 1: BizE Centre Evaluation Framework INTRODUCTION The YouthNow BizE Centre provides early school leavers and disengaged youth with a workplace model integrating career development, employability skills training and real work. The model allows a rolling intake of youth into a work environment where employability skills are given context, peer support and work mentors give guidance. Pre-­‐accredited courses are integrated into the work day. EVALUATION PLAN Desktop Analysis a. Review existing documentation, including mapping goals and strategies b. Research best practice models c. Investigate current situation. Participants a. Design and conduct individual interviews with each participant as part of their orientation to the program b. Design and conduct individual exit interviews with each participant when they leave the program c. Propose a system to record destination data for each participant on leaving the program d. Make a video case study of the impact of the program on participants. Employers a. Design and conduct a survey of individual employers prior to their involvement in the program b. Design and conduct a survey of individual employers after they have been involved in the program YouthNow staff a. Design and conduct a survey of individual staff members in the program b. Conduct a staff meeting. YouthNow Management a. Design and conduct an interview with the CEO of YouthNow b. Design and conduct an interview with a representative of the YouthNow board of management. REPORTING STRATEGY a. Liaison with project manager prior to each key stage. A minimum of one phone call or email update per fortnight b. Prepare an interim report as requested c. Prepare a final report. YouthNow BizE Centre Evaluation 2014 20 Appendix 2: BizE Centre Participant Entry Survey This is a copy of the text used in the online survey distributed on SurveyMonkey. Page 1 Please answer as many of the following questions as you can. You can ask one of the BizE Centre staff to guide you through this survey or you can do it by yourself. The purpose of this survey is to help the BizE Centre get some basic information about why you chose to do this program. This information can then be used to improve the content of the program and how it is delivered to you. Name: Today’s date: (DD/MM/YYYY) Page 2 BizE Centre Participant Survey Answer as many of the questions as you can. Click in the box beside the answers you think are correct. You can click on more than one answer for any of the questions. In the Comment box at the end of each question you can also write anything you think is relevant to the question. 3. Why have you enrolled in the BizE Centre program? ☐ I thought it would be good for my education. ☐ I thought it would help me get a job. ☐ My parents/primary carer thought it would be a good idea. ☐ I was told to do it. ☐ I was referred by an agency. Other (please specify) YouthNow BizE Centre Evaluation 2014 21 4. If I were not enrolled in the BizE Centre, what would I have been doing? ☐ Nothing ☐ I don’t know ☐ I will be looking for a job Other (please specify) 5. Who helped you to get into BizE Centre? ☐ Teachers ☐ Parents/Primary Carer ☐ Careers Counsellor ☐ YouthNow Other (please specify) 6. Thinking about your future employment or future education, at your last school did you: ☐ Talk to a teacher individually about your future employment or future education. ☐ Attend a talk to your class or a group of students about future employment or future education. ☐ Go on an excursion to a place of future employment or future education. ☐ Do class activities on future employment or future education. Other (please specify) 7. Please select what you understand the BizE Centre can do for you ☐ Learning more work skills. ☐ Assist in obtaining ongoing paid employment. ☐ Provide you with ongoing support with job seeking. ☐ All of the above. Other (please specify) YouthNow BizE Centre Evaluation 2014 22 8. Do you have specific employment or education goals that you would like BizE Centre to assist you with? ☐ Yes ☐ No 9. If yes, please list 10 Do you have anything else you would like to comment on? YouthNow BizE Centre Evaluation 2014 23 Appendix 3: BizE Centre Participant Exit Survey This is a copy of the text used in the online survey distributed on SurveyMonkey. BizE Centre Initial Participant Survey July 2013 YouthNow BizE Centre Evaluation 2014 ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ 24 Strongly Disagree Disagree The on-­‐the-­‐job training was interesting and enjoyable. The work experience was relevant to my future employment. The two days a week of the work experience was the right amount for me. The BizE Centre was well setup for me to learn. The staff at the BizE Centre were friendly and helpful to me. Strongly Agree Agree Neutral Page 1 This survey is to be taken by participants when they leave the BizE Centre program. The purpose of this survey is to help the BizE Centre get some basic information about how you have found working at the BizE Centre. This information will be used to improve the program for trainees in the future. Your views are important for us to better understand how the program has affected you. Please answer as many of the following questions as you can. You can ask one of the Work's 4 Me staff to guide you through this survey or you can do it by yourself. Name: Today’s date: (DD/MM/YYYY) Page 2 Please indicate the level to which you agree or disagree with the following statements, where 1 is Strongly Agree (SA) and 5 is Strongly Disagree (SD). Tick one per statement. Thinking about your experience at the BizE Centre: The best part of working at the BizE Centre was: ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ Disagree Gave me relevant work experience. Improved my employability skills. Taught me how to work with others. Taught me how a workplace operates. Supported me to find ongoing paid employment. All of the above. Other (please specify). Neutral Strongly Agree Agree Please indicate the level to which you agree or disagree with the following statements, where 1 is Strongly Agree (SA) and 5 is Strongly Disagree (SD). Tick one per statement. Thinking about your future employment, The BizE Centre: ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ ¡ Thinking about your future employment or education goals did the BizE Centre help you to achieve them? ☐ Yes ☐ No Thinking about your leaving the BizE Centre. Can you please comment on why you are leaving the BizE Centre? YouthNow BizE Centre Evaluation 2014 25 Strongly Disagree ¡ ¡ ¡ ¡ ¡ Can you please comment on where you will be next week and what you will be doing instead of coming to the BizE Centre? Please make any other comment you would like. YouthNow BizE Centre Evaluation 2014 26 Appendix 4: YouthNow Staff Survey This is a copy of the text used in the online survey distributed on SurveyMonkey. Page 1 This survey is for all the YouthNow staff. It is a key part of the evaluation of the Work's 4 Me and the BizE Centre programs and the impact these programs are having on your work. Please take the opportunity to use the questions below to provide your feedback. The responses to this survey will be held by Starfish Consultancy only. A report of the aggregated responses will be part of the Work’s 4 Me and the BizE Centre evaluations. Individual response sheets will not be part of any reporting to the YouthNow administration. Name: (Optional) Page 2 ABOUT THE WORK’S 4 ME AND BIZE CENTRE TRAINEES The following questions focus on the trainees and their impact on your work. Please complete as many questions as you can. If a question is not relevant to you simply move on to the next question. However, the more questions you answer the better the overall survey results will be. Please describe the contact you have had with the Work's 4 Me and BizE Centre trainees? ☐ I have not had contact with the trainees ☐ Casual ☐ Have worked for me ☐ Mentored on a regular basis ☐ Trained on a regular basis ☐ Assisted informally on a limited number of occasions ☐ Assisted formally on a limited number of occasions Other (please describe) YouthNow BizE Centre Evaluation 2014 27 Can you estimate the impact of the trainees on your work? Minimal Significant ¡ ¡ ¡ ¡ ¡ Please describe how the trainees have impacted on your work? How have you found working with the trainees: ☐ Rewarding ☐ Challenging ☐ Distracting ☐ Similar to working with any other young person ☐ Uncomfortable Other (please comment) How satisfied are you with the processes in place to supervise the trainees? Not satisfied Very satisfied ¡ ¡ ¡ ¡ ¡ Please give an example to illustrate your rating. ABOUT THE WORK’S 4 ME AND BIZE CENTRE PROGRAMS The following questions focus on the Work's 4 Me and BizE Centre programs, not the trainees. Please complete as many questions as you can. If a question is not relevant to you simply move on to the next question. However, the more questions you answer the better the overall survey results will be. YouthNow BizE Centre Evaluation 2014 28 How well do you think the Work's 4 Me and BizE Centre programs are working? Poorly Very well ¡ ¡ ¡ ¡ ¡ Please list what you see as working well with the Work's 4 Me and BizE Centre programs. Please list what you see as not working well with the Work's 4 Me and BizE Centre programs. Please list the improvements you would like to see made to either the Work's 4 Me and BizE Centre programs or both programs? ANY OTHER COMMENTS. Please use the space below to make any further comment you would like regarding the Work's 4 Me and BizE Centre programs or both programs. YouthNow BizE Centre Evaluation 2014 29