International Assembly for Collegiate Business Education Report of Outcomes Assessment Results Institution: Wentworth Institute of Technology Academic Business Unit: Academic Year: Facility Planning and Management Program 2014-2015 International Assembly for Collegiate Business Education 11374 Strang Line Road Lenexa, Kansas 66215 USA Outcomes Assessment 1. Do you offer any majors, concentrations, specializations, emphases, options, or tracks as part of your business programs? Yes. If yes, proceed to item 2 below. x No. If no, proceed to item 4 below. 2. Do your majors, concentrations, specializations, emphases, options, or tracks appear on students’ transcripts, diplomas, diploma supplements, or other official records of program completion? Yes. If yes, proceed to item 3 below. No. If no, proceed to item 4 below. 3. Does your current outcomes assessment plan include student learning assessment information for all majors, concentrations, specializations, emphases, options, and tracks contained within your business programs? Yes. If yes, proceed to item 4 below. No. If no, please submit a revised outcomes assessment plan with your interim report that addresses student learning assessment for all majors, concentrations, specializations, emphases, options, and tracks comprising any portion of your business programs. Information about this requirement can be found on the IACBE website at the following address: www.iacbe.org/oa-key-areas.asp. 4. Is the outcomes assessment plan that you submitted to the IACBE still current or have you made changes? x The outcomes assessment plan that we have previously submitted is still current. Changes have been made and the revised plan is attached. We have made changes and the revised plan will be sent to the IACBE by: 1 Outcomes Assessment Results For Academic Year: 2014-2015 Section I: Student Learning Assessment Facility Planning and Management Student Learning Assessment for Program 1 General Program Intended Student Learning Outcomes (General Program ISLOs) 1. Students will demonstrate knowledge of the fundamental principles in business and management together with knowledge concerning current technologies necessary for entry-level facility planning professional practice. 2. Students will apply quantitative decision-support tools and knowledge of the fundamental aspects of the built environment to completing fundamental facilities planning decisions. 3. Students will formulate the team of FM professionals needed to deliver quality building services and explain the critical role the facility manager provides in operations for the organization. 4. Students will apply ethical principles, including correct regulatory codes, to facility planning decisions. 5. Students will demonstrate effective professional communication skills. 6. Students will integrate learning to address real world problems in facility planning. Assessment Instruments for Intended Student Learning Outcomes— Direct Measures of Student Learning: Performance Objectives (Targets/Criteria) for Direct Measures: 1. Capstone Course and Project At least 70% of students score a 3 or 4 in the Capstone rubric for ISLO’s 1- 6. Senior projects evaluated by faculty and external evaluators using common scoring rubrics. 2. Peregrine Test Students will score within 10% of Region 1 IACBE business programs for Outcomes 1, 2, and 4. When additional Facility Management questions relating to Outcomes 1, 2, 3, and 4 are added to the Peregrine Test these will also be piloted and benchmarked for the program. 3. Co-Op Evaluations by Employers Students will receive a 3 or better on their scores for ISLO’s 1-6. 4. 2 Assessment Instruments for Intended Student Learning Outcomes— Indirect Measures of Student Learning: Performance Objectives (Targets/Criteria) for Indirect Measures: 1. Cooperative Education Evaluations from Students At least 75% of students will respond “agree” or “strongly agree” to survey items directly related to Outcomes 1-6. 2. Senior Survey At least 80% of graduates will indicate they have the skills and competencies related to Outcomes 1-6 as indicated by responses to survey items. 3. 4. Assessment Results: Program 1 with a Major, Concentration, Specialization, Emphasis, Option, or Track in Area 1 Summary of Results from Implementing Direct Measures of Student Learning: 1. 78% of completed capstone paper and presentation was judged as 3 or higher across 6 student learning goals. 2. The Peregrine test was implemented for the third time. BFPM students had a mean score of 46.45%. Scores for all management areas are within 10% of Region 1 schools except for Human Resource Management which was 10.72%. 3. 87.5% of students received a score of 3 or higher across ISLOs 1-6. 4. Summary of Results from Implementing Indirect Measures of Student Learning: 1. 92% of students responded 3 or better on the Likert scale for ISLOs 1-6. 2. Graduating seniors complete an online senior survey to determine student satisfaction. 94% of students graduating agreed they can demonstrate knowledge of the ISLOs 1-6. 3. 4. Summary of Achievement of Intended Student Learning Outcomes: Intended Student Learning Outcomes Learning Assessment Measures 3 Capstone Peregrine Test Co-Op Employer Evaluation Direct Measure 4 Performance Target Was… Performance Target Was… Performance Target Was… Performance Target Was… 1. Students will demonstrate knowledge of the fundamental principles in business and management together with knowledge concerning current technologies necessary for entrylevel facility planning professional practice. Met Not Met 2. Students will apply quantitative decision-support tools and knowledge of the fundamental aspects of the built environment to completing fundamental facilities planning decisions. Met 3. Students will formulate the team of FM professionals needed to deliver quality building services and explain the critical role the facility manager provides in operations for the organization. Student Senior Survey Indirect Measure 3 Indirect Measure 4 Performance Target Was… Performance Target Was… Performance Target Was… Performance Target Was… Met Met Met Met Met N/A Met Met Met Met N/A Met 4. Students will apply ethical principles, including correct regulatory codes, to facility planning decisions. Met Met Met N/A Met 5. Students will demonstrate effective professional communication skills. Met N/A Met Met Met 6. Students will integrate learning to address real world problems in facility planning. Met N/A Met Met Met General Program ISLOs Co-Op Evaluation 4 Proposed Courses of Action for Improvement in Learning Outcomes for which Performance Targets Were Not Met: 1. A review of the Summer 2015 Peregrine Exam results of several areas showed that although our students were within 10% of the Region schools, our students’ results were below Region 1 in several subjects including Accounting (6.84%), Business Ethics (3.87%), Legal Environment of Business (9.52%), and Operations/Productions Management (5.45%). To further align IACBE and IFMA requirements and ISLO’s, faculty engaged in review sessions to determine steps to improve the validity of the test. Additional FM content exam questions were added. A review of learning outcomes for the program need to be aligned with both IACBE and IFMA. Faculty are working on curriculum mapping and curriculum revisions. One of the items is to include MGMT 412 Managing and Leading Organizations which would include general management principles. 2. 3. 4. 5 Section II: Operational Assessment (Note: Complete this section only if you received first-time accreditation or reaffirmation of accreditation after January 1, 2011.) Facilities Management Operational Assessment Intended Operational Outcomes: 1. Provide qualified faculty 2. Keep programs relevant and vibrant 3. Use current technology in the classroom 4. Provide interdisciplinary, project-based learning 5. Provide effective student advising 6. Retain qualified students Assessment Measures/Methods for Intended Operational Outcomes: 1. A. Maintain faculty and student evaluations B. Maintain senior exit survey 2. A. Maintain IPACs as external advisors B. Use qualified external professional reviewers for capstone Performance Objectives (Targets/Criteria) for Operational Assessment Measures/Methods: 80% of faculty score 3 or better in categories of Teaching, Scholarly Activitiy, and Service Maintain an average score 3 or higher for student survey on questions pertaining to faculty Regular IPAC meetings (at least once per year) At least one external reviewer per capstone course 3. Continue to upgrade laptop and other technology programs 100% of enrolled students receive laptops their freshman and junior years 4. Interface with other programs/departments on projects At least 50% of our students will have the opportunity to engage in an interdisciplinary project. 5. Maintain high quality advising On the student satisfaction survey provided by student leadership 70% of students will agree or strongly agree on questions pertaining to advisors 6. Work closely with Institutional Research and other offices across campus as needed Maintain a retention rate of at least 80%. 6 Summary of Results from Implementing Operational Assessment Measures/Methods: 1. A. 95% of faculty scored 80% or higher in student evaluations 2. A. IPAC met once during 2013-2014 academic year. B. 92% scored 3 or higher on the senior exit survey B. Capstone had an average 15 external reviewers. 3. 100% of enrolled students receive laptops their freshman and junior years. 4. We have developed and added two advanced practicum courses that include interdisciplinary projects. 5. 75.4% of students agreed or strongly agreed on questions pertaining to advisors 6. Raw retention rate for the academic year 2014-2015 as calculated by the office of Institutional Research is 70% (7/10 freshman were retained). However, the program also gained 6 transfer freshman for the academic year 2014-2015. Retention rate for academic year 2015-2016, is currently at 100%. Summary of Achievement of Intended Operational Outcomes: Operational Assessment Measures/Methods Intended Operational Outcomes 1. Provide qualified faculty Faculty Evaluation Student Evaluation Senior Exit Survey IPAC External Reviews Laptop Program EPIC Project Advising Performance Target Was… Performance Target Was… Performance Target Was… Performance Target Was… Performance Target Was… Performance Target Was… Performance Target Was… Performance Target Was… Met Met Met Met Met 2. Keep programs relevant and vibrant 3. Use current technology in the classroom Met 4. Provide interdisciplinary, projectbased learning Met 5. Provide effective student advising Met 6. Retain qualified students Met Proposed Courses of Action for Improvement in Operational Outcomes for which Performance Targets Were Not Met: 1. The BFPM program acquires more students than it loses. 2. 7 3. 4. 8