University of North Carolina Wilmington Educational Program Assessment Plan and Report Assessment Plan for 2011-2012 Cameron School of Business Primary Contact Name/Info: Becky Porterfield, AoL Director, Cameron School of Business Degree: Master of Business Administration MBA Program Outcomes PO 1: Apply business knowledge and skills effectively in a variety of settings. UNCW Goal 5 PO2: Demonstrate the ability to make strategic, integrative decisions. UNCW Goal 1 PO3: Demonstrate an understanding of professional responsibility, ethical obligations, and social awareness. UNCW Goal 3 The program goals were just developed after a comprehensive programs review – measurements are currently being developed. The program goals were just developed after a comprehensive programs review – measurements are currently being developed. Vince Howe, MBA Program Director Assessment of Learning Alliance (LA) evaluation metrics completed for PMBA Class of 2011 (8/10) and 2012 (11/11). Vince Howe, MBA Program Director Assessment of LA metrics and assessment of Executive Challenge (capstone course) projects were completed for PMBA Class of 2011 (5/12) The program goals were just developed after a comprehensive programs review – measurements are currently being developed. Vince Howe, MBA Program Director Assessment of CSR criteria begun in Executive Challenge class especially relative to ethics and sustainability. Revision of program based on task force recommendations will continue focus on active based learning and applied skills. Results indicate that students do a good job in integrating functional and macroenvironmental material in decision making. Integration metrics will continue to be used in revised PMBA program beginning Fall 2013. Assessment of CSR criteria will continue with greater focus on ethics due to students ‘ lack of knowledge relative to FCPA. Addition cases focusing on sustainability and Equator Principles. PO4: Demonstrate competency in the global aspects of business. UNCW Goal 4 PO5: Princeton Review Best Business Schools Award. The program goals were just developed after a comprehensive programs review – measurements are currently being developed. Vince Howe, MBA Program Director Task Force review of programs global curriculum revealed caps between our program relative to peer and aspirant schools. Independent survey of current students to assess experience. Princeton Review, MBA Director coordinator implements student survey Reviewed results of 2012 report where CSB PMBA program was listed in top programs. Ongoing program goal Vince Howe, MBA Program Director Review of admissions criteria completed. Concerns regarding students admitted as exceptions UNCW Goal 1 PO6: Improve overall quality of students in program. UNCW Goal 1 MBA Student Learning Outcomes Student Learning Tools Outcome UNCW Strategic Goal SLO1: Our graduates will A: Ethics understand the Method: A rubric is used importance of ethics, to evaluate write-ups on corporate social critical incidents written responsibility and the by all students. need to reflect that understanding in their actions and decisions. UNCW Goal 3 Revision of program based on task force recommendations led to addition of required Global Strategy class which will be taught in Fall 2014. Discussions with Thom Rakes, Career Services to improve service offerings to PMBA students. Key complaint in Princeton report. Changes recommended and awaiting approval regarding percent of exceptions allowed. Implementation Summary of Findings Actions Taken Administration: This assessment is conducted by faculty in MBA 556—Executive Challenge on all students each spring and in MBA 541 Marketing Decision Making in Summer 1 each year. Results are reviewed and changes made by the MBA Committee. Trend data on ethics metric shows improvement but absolute score still a concern. Students exhibed lack of knowledge in FCPA – Banking Incident in Vietnam which led to new focus ethics. Curriculum in revised PMBA program will focus on ethical decision making in each functional business area. B: Social Responsibility Method: a rubric is used to evaluate write-ups on critical incidents written by all students. SLO2: Our graduates will have the leadership and team-building skills necessary to lead organizations in a dynamic environment, i.e. can act as change agents. A: Teamwork and Leadership Method: A scaled peer evaluation form is used on both dimensions for assessment. UNCW Goal 1 B: Change Method: A rubric is used to assess a course exercise focused on understanding change. Administration: This assessment is conducted by faculty in MBA 556—Executive challenge on all students each spring each year. Results are reviewed and changes made by the MBA Committee. Administration: All learning alliance teams conduct this assessment in the MBA 553 Learning Alliance Integration projects. All students participate. The assessment is conducted each fall and the results are reviewed and changes made by the MBA committee. Administration: A faculty member reviews the change exercises against the rubric for all students in the MBA 555 Leading Organizational Change course. Data is collected each fall and is reviewed by the MBA Committee for recommended changes to the curriculum. Assessment of critical incident challeges reveals slight decline in social responsibility. Case involving Equator Principals reveals little focus on the people side of the three P’s. Curriculum in revised PMBA program will focus on Triple Bottom line with greater emphasis on people and planet. Review of teamwork metrics shows a steady increase in rubrics. Assessment will continue but discussions to apply teamwork metrics in different circumstances discussed, e.g. rotating team leadership and reassessing given new roles of student members. Task Force recommendations for new program discussed need for totating team responsibility for Learning Alliance Team members. Multiple LA assignments will allow for assessment of students in different roles. Organizational change metric shows slight decline which may be due to different case related material. Data will also be checked relative to percentage of engineers in various Disccusions with Org. Change instructor relative to stability of cases/scenarios designed to assess org. change behavior and attitude. . SLO3: Our graduates will have the necessary oral and written communication skills to effectively interact with their stakeholders. UNCW Goal 1 A: Oral Communication Method: A rubric is used to assess student presentations and additionally peer assessment is reviewed on relevant item assessments on Learning Alliances. B: Written Communication Method: ETS Criterion online essay assessment is used. SLO4: Our graduates will be able to apply knowledge in unfamiliar and dynamic circumstances through a conceptual understanding of relevant disciplines. UNCW Goal 1 A: Critical Thinking and Decision Making Method: Rubrics are used to assess both critical thinking and decision making. cohorts. Administration: Faculty Oral communication members in MBA 553 Learning rubrics continue to be Alliance Integration use the assess in Learning rubric to assess all student Alliance presentations. This is presentations. Overall conducted upon completion trend effective but of the Learning Alliance and is focus needed on generally done in the fall mechanics. semester. Results are reviewed and changes made by the MBA Committee. Administration: This assessment is conducted every spring with students in the MBA 556 Executive Challenge course. Results are reviewed and changes made by the MBA Committee. Administration: Practicum projects (MBA 557 Industry Practicum) and MBA 556 Executive Challenge critical incident write-ups are evaluated against the rubrics by faculty members. These assessments are conducted each spring. Results are reviewed and changes made by the MBA Committee. B: Integration Administration: Practicum Method: A rubric is used projects (MBA 557 Industry Task Force recommendations for revised PMBA program focused on needs for oral and written communication skills. Use of presentation software and virtual team facillatation software will be presented to new cohort students. On-line asssssement of student written communication skills terminated. Need to determine new metrics to assess written communications skills prior to introduction of revised PMBA program in Fall 2013. Active based learning projects provide students with numerous decision making opportunites which are assessed in Learning Alliance, Practicum and Executive Challenge classes. Results good over all courses. Revision of program based on task force recommendations will continue focus on active based learning and applied skills and relevant assessment of decision making and critical thinking skills. for integration. Practicum) and MBA 556 Executive Challenge critical incident write-ups are evaluated against the rubrics by faculty members. These assessments are conducted each spring. Results are reviewed and changes made by the MBA Committee. Assessment of LA metrics and assessment of Executive Challenge (capstone course) projects were completed for PMBA Class of 2011 (5/12) SLO5: Our graduates will have the capacity to adapt and innovate to solve problems, to cope with unforeseen events, and to manage in unpredictable environments. Method: a rubric is used for integration. UNCW Goal 1 SLO6: Our graduates will demonstrate an understanding of global business practices that embrace the Method: Rubric used for assessment. Administration: Practicum projects (MBA 557 Industry Practicum) and MBA 556 Executive challenge critical incidents write-ups are evaluated against the rubrics by faculty members. These assessments are conducted each spring. Results are reviewed and changes made by the MBA Committee. Administration: Project conducted in MBA 541 Marketing Decision Making is used for assessment by the faculty member. Assessment Continuation of critical incident exercises in Executive Challenge courses to assess students reactions to unforeseen events. Integration metrics shows trend upward but still absolutely low. Cases on multinational corporations and global operations revealed lack of knowledge relative to Results indicate that students do a good job in integrating functional and macroenvironmental material in decision making. Integration metrics will continue to be used in revised PMBA program beginning Fall 2013. Integration scale to be utilized in other active based projects, e.g. LA and Practicum to assess multiple integration opprotunities. Metrics and task force review of other programs has led to a new Global Strategy course being added to revised curriculum opportunities of multicultural, diverse environments, as they relate to local, national and global operations. UNCW Goal 3, 4 is conducted in Summer 1 session each year. Results are reviewed and changes made by the MBA Committee. FCPA and other issues relative to entering a foreign market, e.g. Alcatel in China. beginning in Fall 2014. Appendix A: MBA SLO1 Findings 1. Ethics Assessment Results, Spring 2011 Average Score Ethics 4.0 3.5 3.0 2.5 2.0 1.5 1.0 0.5 0.0 2.55 2.24 2.00 Class of 2008 in Spring 2008 (N=41) Class of 2009 in Spring 2009 (N=33) Class of 2011 in Spring 2011 (N=40) Average Score 2. Corporate and Social Responsibility Assessment Results, Spring 2011 4.0 3.5 3.0 2.5 2.0 1.5 1.0 0.5 0.0 Corporate & Social Responsibility 2.98 2.79 2.55 Class of 2008 in Spring 2008 (N=41) Class of 2009 in Spring 2009 (N=33) Class of 2011 in Spring 2011 (N=40) Appendix B: MBA SLO2 Findings 1.Teamwork Assessment Results, Fall 2010 Rating Scale: 1 = poor performance level; 2 = below expected performance level; 3 = met expected performance level; 4 = exceeded expected performance level; 5 = superior performance level 2. Leadership Assessment Results, Fall 2010 Rating Scale: 1 = poor performance level; 2 = below expected performance level; 3 = met expected performance level; 4 = exceeded expected performance level; 5 = superior performance level 3. Change Assessment Results, Fall 2010 MBA 555 Leading Organizational Change Assessments 4.00 3.00 2.00 2.49 2.49 2.36 2.12 1.95 2.35 2.00 Avg. 1.00 0.00 Fall 2007 Fall 2007 Fall 2008 Fall 2008 Fall 2009 Fall 2009 Fall 2010 Performance Performance Performance Performance Performance Performance Performance Rating 1 Rating 2 Rating 1 Rating 2 Rating 1 Rating 2 Rating 1 Appendix C: MBA SLO3 Findings 1. Oral Communication Assessment Results, Fall 2008 2. Written Communication Assessment Results, Spring 2010 Appendix D: MBA SLO4 Findings 1. Critical Thinking Assessment Results, Spring 2010 2. Integration Assessment Results, Spring 2011 Integration 4.0 Average Score 3.5 3.0 2.5 2.34 2.42 Class of 2008 in Spring 2008 (N=41) Class of 2009 in Spring 2009 (N=33) 2.6 2.15 2.0 1.5 1.0 0.5 0.0 Class of 2010 in Spring 2010 (N=40) Class of 2011 in Spring 2011 (N=40) Appendix E: MBA SLO5 Findings Problem Solving Assessment Results, Spring 2010 Appendix F: MBA SLO6 Findings Valuing Diversity Assessment Results, Spring 2011 Understanding Diverse Environments 4.0 Average Score 3.5 3.0 2.5 2.44 2.30 2.24 2.60 2.65 Valuing Diversity Measure 1 2.0 1.5 Valuing Diversity Measure 2 1.0 0.5 0.0 Class of 2008 in Spring 2008 (N=41) Class of 2009 in Spring 2009 (N=33) Class of 2011 in Spring 2011 (N=40)