Program Outcomes Assessment
Transcription
Program Outcomes Assessment
Penn College Construction Management AIC/ CQE Results Outcomes Assessment Summary About the Associate Constructor Certification Taken from the AIC Website - http://www.professionalconstructor.org/?page=AC_Certification The Associate Constructor (AC) is the first level of certification in the Constructor Certification Program. This level of certification is ideal of recent graduates of 4-Year Construction Management Programs or those transitioning into construction management from other industries. To take the Associate Constructor or Level 1 Exam a candidate must qualify by meeting one of the following requirements: 1. Have graduated from or is scheduled to graduate from an accredited 4-year Construction Management Degree Program. (Individuals will earn the AC certification upon passing the exam and provided proof of graduation.) 2. Have obtained 4 years of qualifying experience or education or a combination of the two. Upon passing the Associate Constructor Exam an individual will be awarded the Associate Constructor (AC) credential. The AC exam is made up of 300 multiple choice questions, given during two 4 hour sessions on a single day. The exam is given twice per year, in the spring and fall at over 60 locations across the country. Over 50 University Construction Management Programs currently administer the AC exam, most require the exam as part of their program curriculum. Penn College use of the CQE The CQE exam has become a keystone of the program outcomes assesment plan. The construction management program began considering the use of the CQE in 1995 and upon completion of the review began requiring all final semester seniors to sit for the certification in the Spring of 1997. Seniors in the BCM497 Capstone course must register for the Spring Exam offered on campus, typically during the beginning of April. Students must secure an established minimum score (currently lower than the 210 required to attain the credential) in order to be eligible to pass the course and graduate. This lower score began much lower than the passing mark but has been raised each year. In 2014, the required score was 185. Failure to secure the minimum score results in the student receiving an incomplete for the course. Students are then responsible for making arrangements to retake the exam during the Fall testing dates and sending the official scores to the instructor. If the minimum score is reached, the grade is changed to that reflected by the students coursework. If the score is not reached, the grade is changed to failing and the student is required to retake the class during the next spring semester. Page 1 of 10 Penn College Construction Management AIC/ CQE Results Outcomes Assessment Summary The initial use of the exam as part of the Capstone class in 2007 required that students sit for the exam but did not tie performance to a grade or require a minimal level of effort. Upon examining the results and interviews with seniors, it was descovered that some students had not studied and had zero interest in doing well. Faculty proposed tieing the performance to their grade and also decided to set a minimum threshold of performance that would start below the CQE passing mark but that would eventually raise up to that standard. By the third year of implementation Penn College scores exceeded the national average and have stayed there for six straight years. The scope of the CQE exam and the track-record of performance by graduating seniors is viewed as strong evidence that the program is producing graduates who have a strong skill set for the industry. Page 2 of 10 Penn College Construction Management AIC/ CQE Results Outcomes Assessment Summary Penn College National 19 15 978 483 Difference 225.11 204.86 20.25 20.42 20.22 0.2 Notes: Beat national average overall by over 20 points. Higher than national average in all categories. We see this as confirmation that the program is covering the appropriate content and students are retaining information required. No major changes proposed at this time as a result of this instrument. High score = 99th percentile, 2nd was 98th percentile. Actions: Keep doing what is working. 9.74 27.37 22.63 33.16 26.42 35.84 17.37 9.08 25.00 20.49 28.62 23.11 32.37 15.12 0.66 2.37 2.14 4.54 3.31 3.47 2.25 Project Administration Construction Geomatics Construction Safety Planning, Scheduling, & Schedule Control Budgeting,Costs, Cost Control Bidding & Estimating Materials, Methods, & Proj Modeling & Visualization Management Concepts Engineering Concepts Communications Average # Passed # Taken 2014 CQE Results 5.05 27.11 4.59 26.27 0.46 0.84 2014 Penn College BCM vs. National CQE Results by Concentration 40.00 35.00 30.00 25.00 20.00 15.00 10.00 5.00 0.00 National Penn College Page 3 of 10 Penn College Construction Management AIC/ CQE Results Outcomes Assessment Summary Penn College National 20 14 1013 537 Difference 216.3 208.93 7.37 22.75 21.52 1.23 Notes: Higher than national average but small deficiencies in Engineering (Historically a weak point in our nonengineering based approach) and Budgeting, Costs, and Cost Control categories. Both were minor misses. Faculty to increase attention in these areas over the next year but no major changes proposed. High score = 96th percentile. Actions: Increase focus on Engineering and Budgeting, Costs and Cost Control areas slightly. 8.45 27.10 22.30 29.65 23.60 34.85 16.55 9.16 25.39 20.53 29.21 24.02 33.45 15.35 -0.71 1.71 1.77 0.44 -0.42 1.4 1.2 Project Administration Construction Geomatics Construction Safety Planning, Scheduling, & Schedule Control Budgeting,Costs, Cost Control Bidding & Estimating Materials, Methods, & Proj Modeling & Visualization Management Concepts Engineering Concepts Communications Average # Passed # Taken 2013 CQE Results 4.70 26.35 4.64 25.65 0.06 0.7 2013 Penn College BCM vs. National CQE Results by Concentration 40 35 30 25 20 15 10 5 0 National Penn College Page 4 of 10 Penn College Construction Management AIC/ CQE Results Outcomes Assessment Summary Penn College National 28 23 1271 737 Difference 229.07 210.59 18.48 22.93 21.46 20.62 20.25 2.31 1.21 Notes: Beat national average overall and in every category! Did not notice anything exceptionally different from previous years student groups and while the review is better with time there were no major changes. Possibly we are seeing results of coverage of the AIC materials (both purposeful and not) as the exam has pervaded our (faculty & student) thinking at all levels of the program coursework. Actions: Keep doing what is working. 26.5 24.64 32.96 20.36 36.43 14.96 25.83 21.42 29.86 19.31 34.25 13.05 0.67 3.22 3.1 1.05 2.18 1.91 5.82 5.02 0.8 Project Administration Construction Geomatics Construction Safety Planning, Scheduling, & Schedule Control Budgeting,Costs, Cost Control Bidding & Estimating Materials, Methods, & Proj Modeling & Visualization Management Concepts Engineering Concepts Communications Average # Passed # Taken 2012 CQE Results 23 20.95 2.05 2012 Penn College BCM vs. National CQE Results by Concentration 40 35 30 25 20 15 10 5 0 National Penn College Page 5 of 10 Penn College Construction Management AIC/ CQE Results Outcomes Assessment Summary Penn College National 29 21 1132 701 Difference 217.31 215.89 1.42 10.97 18.59 10.87 19.13 0.1 -0.54 Notes: Penn College BCM students scored higher than the Bational Average for the third straight year. Still have some individual students not doing well. These students are mostly predictable based on in-class experiences in other classes and/or known test anxiety issues. Actions: Increase focus on Budgeting, Costs and Cost Control and review what we are doing in this area. 9.34 23.93 36.66 20.69 36.38 15.72 9.51 23.13 35.63 21.76 35.54 15.92 -0.17 0.8 1.03 -1.07 0.84 -0.2 Project Administration Construction Geomatics Construction Safety Planning, Scheduling, & Schedule Control Budgeting,Costs, Cost Control Bidding & Estimating Materials, Methods, & Proj Modeling & Visualization Management Concepts Engineering Concepts Communications Average # Passed # Taken 2011 CQE Results 4.86 40.17 4.55 39.83 0.31 0.34 2011 Penn College BCM vs. National CQE Results by Concentration 45 40 35 30 25 20 15 10 5 0 National Penn College Page 6 of 10 Penn College Construction Management AIC/ CQE Results Outcomes Assessment Summary Penn College National 29 21 1132 701 Difference 217.31 215.89 1.42 10.97 18.59 10.87 19.13 0.1 -0.54 Notes: Had two students do poorly in every category which hurt the averages. Can we adjust the numbers if we have students that blow off the test or do poorly for reasons outside of the programs control? Above National Average again. Actions: Continue to discuss options for examinees who don't try or have other issues that don't reflect the programs achievement. For now, no adjustments. 9.34 23.93 36.66 20.69 36.38 15.72 9.51 23.13 35.63 21.76 35.54 15.92 -0.17 0.8 1.03 -1.07 0.84 -0.2 Project Administration Construction Geomatics Construction Safety Planning, Scheduling, & Schedule Control Budgeting,Costs, Cost Control Bidding & Estimating Materials, Methods, & Proj Modeling & Visualization Management Concepts Engineering Concepts Communications Average # Passed # Taken 2010 CQE Results 4.86 40.17 4.55 39.83 0.31 0.34 2010 Penn College BCM vs. National CQE Results by Concentration 45 40 35 30 25 20 15 10 5 0 National Penn College Page 7 of 10 Penn College Construction Management AIC/ CQE Results Outcomes Assessment Summary Penn College National 25 18 1009 666 Difference 224.08 219.69 4.39 12.24 20.16 11.65 20.01 0.59 0.15 Notes: BEAT THE NATIONAL AVERAGE! Improved or held close in most categories. Systems are working and the culture of knowing about the exam and coming into the final semester ready to take it on is helping. Had one student not meet the threshold. Many pains with parents regarding delayed graduation. Having statistics from classmates and national averages was helpful and the shift of responsibility to the student in this case Actions: Continue to beat the average, continue to work on communications across the curriculum. 9.48 23.16 9.59 22.33 -0.11 0.83 35.6 23.72 35.92 16.52 34.85 23.33 34.71 16.83 0.75 0.39 1.21 -0.31 Project Administration Construction Geomatics Construction Safety Planning, Scheduling, & Schedule Control Budgeting,Costs, Cost Control Bidding & Estimating Materials, Methods, & Proj Modeling & Visualization Management Concepts Engineering Concepts Communications Average # Passed # Taken 2009 CQE Results 5.04 42.24 4.84 41.54 0.2 0.7 2009 Penn College BCM vs. National CQE Results by Concentration 45 40 35 30 25 20 15 10 5 0 National Penn College Page 8 of 10 Penn College Construction Management AIC/ CQE Results Outcomes Assessment Summary Project Administration Construction Geomatics Planning, Scheduling, & Schedule Control Budgeting,Costs, Cost Control 7.24 19.5 9 1154 664 211.14 8.89 19.8 8.98 23.36 34.88 21.9 30.71 15.41 6.19 41.03 Difference -6.07 -1.65 -0.3 0.02 0.14 0.83 -2.83 -0.64 -1.27 0.38 -0.82 Average Notes: Improvement in most areas. Had one student not meet the minimum threshold. He was required to retake the exam in the fall and received an Incomplete for the course. Process is developing nicely. Update: This student performed much better on the fall exam. Action: Let underclassmen know about the exam and the ramifications of not performing to a minimum standard. Instill a culture of the exam being a testimony to what they have learned and are prepared to do. Continue to tweak prep course, look into alternative methods of study and prep. Focus on Communications Skills accross curriculum. Construction Safety 205.07 Bidding & Estimating Engineering Concepts National Materials, Methods, & Proj Modeling & Visualization Communications 5 # Passed 14 # Taken Penn College Management Concepts 2008 CQE Results 23.5 35.71 19.07 30.07 14.14 6.57 40.21 2008 Penn College BCM vs. National CQE Results by Concentration 45 40 35 30 25 20 15 10 5 0 National Penn College Page 9 of 10 Penn College Construction Management AIC/ CQE Results Outcomes Assessment Summary National Construction Geomatics 1040 671 216.94 11.85 23.38 9.79 25.58 32.13 22.58 30.64 18.22 8.14 34.64 Difference -15.37 -2.5 -3.08 -1.05 -1.1 -0.43 -1.97 -2.07 -0.39 -1.01 -1.77 Average Notes: The initial year of adoption. This year served as a wake-up call for the faculty and students alike. There was much to learn about preparing for the exam and how to review concepts from across the entire curriculum. With the program goal of beating the national average, we need to work on all areas of coverage in review and exam prep but feel the program is covering the majority of the concepts.. We also need to require a certain level of performance or some students do not try or let disregard it due to other time commitments senior year. thresholds and Actions: Implement minimum benchmark grades related to course grades. Continue to develop systems for program content review. 31.7 20.61 28.57 17.83 Project Administration 8.74 24.48 Construction Safety 20.3 Budgeting,Costs, Cost Control Management Concepts 9.35 Bidding & Estimating Engineering Concepts 201.57 Materials, Methods, & Proj Modeling & Visualization Communications 9 # Passed 23 # Taken Penn College Planning, Scheduling, & Schedule Control 2007 CQE Results 7.13 32.87 2007 Penn College BCM vs. National CQE Results by Concentration 40 35 30 25 20 15 10 5 0 National Penn College Page 10 of 10