University of North Carolina Wilmington Student Learning Outcome Assessment Plan and Report Assessment Plan for 2011-2012 Cameron School of Business Primary Contact Name/Info: Becky Porterfield, AoL Director, Cameron School of Business Degree: BS in Business Administration (BSBA) BSBA Student Learning Outcomes Student Learning Tools Outcome UNCW Strategic Goal SLO1: Our students will a. Content Knowledge be able to integrate Sixty question multiple discipline-specific choice assessment knowledge across representing five key areas functional areas and each for 13 business core utilize leadership and classes. team skills to accomplish group tasks. UNCW Strategic Goal 1 UNCW Learning Goals – foundational knowledge Implementation Required for all students registered in MGT 455 class (capstone strategy course required for all BSBA students). Administered every semester on-line. Each department reviews its set of questions relevant to its business core class for student learning improvement and makes changes as needed. Summary of Findings Appendix A.1.a Appendix A.1.b Actions Taken Based on AACSB recommendation, the CSB implemented the on-line assessment for all students seeking to pre-register for MGT 455. Prior to implementation all courses reviewed content knowledge questions. Instrument was changed from 60 questions to 100 questions. The average first responses for Fall 2011 was 61.14%. This indicates that the 60% margin at this time is appropriate. Individual business core classes did not change due to the early results of this data and the new assessment format. Classes will be evaluated when three sets of data are complete. Student Learning Outcome UNCW Strategic Goal Tools Implementation b. Integration Method: Rubric use d in MGT 455 capstone class by faculty member to assess functional integration Every semester MGT 455 is offered including summer for all students in course. Management faculty review data for improvements. Appendix A.2 In February 2012 the first CSB assessment day was conducted. Faculty working in teams used assessment data to make recommendations. Recommendations now before the curriculum committee to improve integration are 1) faculty to develop common expectations for integration. Develop website to provide the material. 2) Assess and reduce the number of overrides For pre-requisites for MGT 455. Every semester in MGT 455 class (capstone strategy course). Management faculty review data for improvements. Appendix A.3 In February 2012 the first CSB assessment day was conducted. Faculty working in teams used assessment data to make recommendations. As a result additional teamwork training is being added to the new BUS205 and BUS405 course to improve SLO. c. Team Building Method: Rubric used in MGT 455 course by students that assess each team member in their project team groups Summary of Findings Actions Taken Student Learning Outcome UNCW Strategic Goal Tools d. Leadership Method: Rubric used in MGT 455 by all students to assess the leadership skills of their team leaders in their project teams. SLO2: Our students will demonstrate critical thinking and problem solving skills through problem identification, analysis and synthesis of data, evaluation of alternatives, and defense of a solution. UNCW Goal 1 Implementation Summary of Findings Actions Taken Every semester in MGT 455 class (capstone strategy course). Management faculty review data for improvements. Appendix A.4 In February 2012 the first CSB assessment day was conducted. Faculty working in teams used assessment data to make recommendations. As a result additional leadership training is being added to the new BUS205 and BUS405 course to improve SLO. a. Problem Solving Method: At the end of the semester in the Production Management course (POM 370), a non-graded problem is added to assess problem solving. Using a problem solving rubric, a faculty member who does not teach the course, assesses the ability to problem solve for each student. Assessment is conducted every semester POM 370 is taught from a sample of student work. The AOL committee reviews the work and passes it to the curriculum committee as needed. Appendix B.1 Data is being collected using the new assessment method for problem solving. This data will be reviewed in spring 2012 for potential improvement in student learning outcome. No changes recommended to date. b. Critical Thinking Method: At the end of the semester in the Production Management course (POM 370), a non-graded problem is added to assess problem Assessment is conducted every semester POM 370 is taught from a sample of student work. The AOL committee reviews the work and passes it to the Appendix B.2 In February 2012 the first CSB assessment day was conducted. Faculty working in teams used assessment data to make recommendations. This data will be reviewed in spring 2012 for Student Learning Outcome UNCW Strategic Goal SLO3: Our students will be able to conceptualize a complex issue into a coherent written statement and oral presentation, demonstrated with the effective use of technology. UNCW Goal 1 Tools Implementation Summary of Findings Actions Taken solving. Using a critical thinking rubric, a faculty member who does not teach the course, assesses the ability to problem solve for each student. curriculum committee as needed. a. Written Communication Method: The CSB subscribes to ETS’s written communication instrument for assessing writing ability within the CSB. The ETS written assessment was used for several years. Analysis by a faculty team concluded this method was ineffective. A writing team was established. Appendix C.1 In February 2012 the first CSB assessment day was conducted. Faculty working in teams used assessment data to make recommendations. The faculty forward to the CSB curriculum committee recommendations including the establishment of a required business communication class. In the interim two writing assessments are being conducted in the BUS205 and then again in the BUS405 course for pre and post assessment purposes utilizing a rubric for assessment. b. Oral Communication/ Technology Use Method: All faculty in the This assessment is conducted every semester in MGT 455 by Appendix C.2 In February 2012 the first CSB assessment day was conducted. Faculty working in teams used potential improvement in student learning outcome. Improve through case training in BUS405. Student Learning Outcome UNCW Strategic Goal SLO4: Our students will understand the importance of social responsibility, diversity, ethics and legal issues. UNCW Goal 3 Tools Implementation MGT 455 CSB capstone course (strategy course) use a rubric (encompassing components of oral communication and the use of technology) to assess individuals as they present in their project teams for the semester. all faculty teaching the class. The management faculty review the data for recommended actions. a. Ethics, Social Responsibility, and Diversity Method: This assessment is conducted by utilizing questions directly related to these three areas from the content knowledge assessment conducted for students registered in MGT 455. The assessment instrument is required for all students and is online. This assessment is conducted every semester and is evaluated by the curriculum committee. Summary of Findings Actions Taken assessment data to make recommendations. As a result the faculty recommended a minimum of one presentation for each concentration in a 300 level course and one presentation in BUS205. Appendix D.1 Appendix D.2 Appendix D.3 Insufficient data was being gathered on the dimensions of ethics, social responsibility, and diversity. This assessment is now included in the content knowledge of SLO1. The assessment instrument was changed to include more extensive assessment of these qualities and is being included in the 60% requirement for pre-registration in MGT 455. In February 2012 the first CSB assessment day was conducted. Faculty working in teams used assessment data to make recommendations. As a result 10 hours of volunteer work have been added to the BUS405 course for social responsibility focused on diverse populations. Student Learning Outcome UNCW Strategic Goal SLO5: Our students will demonstrate an understanding of global business practices that embraces the opportunities of multicultural, diverse environments, as they relate to local, national and global operations. UNCW Goal 4 Tools Implementation a. Legal Issues Method: This assessment is conducted by utilizing questions directly related to the legal environment (BLA 361) from the content knowledge assessment conducted for students registered in MGT 455. The assessment instrument is required for all students and is online. This assessment is part of the content knowledge assessment and is conducted every semester and is evaluated by the BLA faculty Method: This assessment is conducted by utilizing questions directly related to international business (INB 300 course) from the content knowledge assessment conducted for students registered in MGT 455. This assessment is now imbedded in the online requirement for all students wishing to preregister for MGT 455 every semester and is evaluated by the international business committee Summary of Findings Appendix D.4 Actions Taken The average first responses for Fall 2011 was 61.14%. This indicates that the 60% margin at this time is appropriate. Individual business core classes did not change due to the early results of this data and the new assessment format. Classes will be evaluated when three sets of data are complete. Appendix C.l The average first responses for Fall 2011 was 61.14%. This indicates that the 60% margin at this time is appropriate. Individual business core classes did not change due to the early results of this data and the new assessment format. Classes will be evaluated when three sets of data are complete. Appendix A: BSBA SLO1 Findings 1. Content-Knowledge Assessment Results as of December 2011 a. Content-Knowledge Assessment Trends Percentage of Assessments in Range % Correct % in Range Spring 08 (N=119) % in Range Fall 08 (N=95) % in Range Spring 2009 (N=78) % in Range Fall 09 (N=25) % in Range Spring 2010 (N=25) % in Range Fall 10 (N=45) % in Range Summer 2011 (N=16) % in Range Fall 2011 (N=339) 100 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 90-99 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 80-89 0.84% 1.05% 1.28% 0.00% 8.00% 2.22% 0.00% 4.13% 70-79 12.61% 15.79% 17.95% 36.00% 48.00% 35.56% 25.00% 32.15% 60-69 28.57% 36.84% 50.00% 40.00% 32.00% 31.11% 56.25% 39.53% 50-59 39.50% 48.42% 23.08% 16.00% 8.00% 22.22% 18.75% 10.91% 40-49 14.29% 16.84% 6.41% 8.00% 4.00% 6.67% 0.00% 2.36% 30-39 5.04% 6.32% 0.00% 0.00% 0.00% 0.00% 0.00% 1.18% 20-29 2.52% 0.00% 1.28% 0.00% 0.00% 2.22% 0.00% 1.47% 10-19 15.13% 1.05% 0.00% 0.00% 0.00% 0.00% 0.00% 1.77% 5.88% 0.00% 0.00% 0.00% 0.00% 0.00% 0.00% 6.49% 0-9 Average Percentage by Semester Average Percentage by Semester 100% 80% 57.06% 58.32% 61.92% 64.93% 68.80% 63.33% 65.38% 61.14% Mean = 62.61% 60% 40% Avg. % 20% 0% Spring 08 (N=119) Fall 08 (N=95) Spring 09 (N=78) Fall 09 (N=25) Spring 10 (N=25) Fall 10 (N=45) Summer 11 Fall 11 (N=16) (N=339) Average Percentage Correct by Course Content Knowledge Course Averages 100% 88.80% 84.44% 81.58% 90% 80% 70% 67.11% 66.61% 65.60% 70.40% 68.03% 67.20% 59.11% 60% 61.78% 75.11% 74.40% 74.37% 72.00% 73.60% 72.10% 66.56% 64.89% 62.22% 60.57% 80.00% 70.67% 66.65% 59.30% 56.80% 51.34% 50.67% 48.80% 50% 71.20% 67.14% 56.80% 64.00% 51.45% 52.00% 49.33% Spring 2010 Fall 2010 Fall 2011 40% 30% 20% 10% 0% ACG 201 ACG 203 BLA 361 ECN 221 ECN 222 FIN 335 INB 300 MGT 350 MIS 213 MKT 340 OPS 370 QMM 280 b. AOL Content-Knowledge Assessments by Course ACG 201 AOL Content Knowledge Fall 2011 100% 90% 80% 91.35% 79.46% 81.82% 79.09% 79.61% 75.79% 70.30% 67.27% 70% 87.37% 82.29% 68.48% 70.21% 65.22% 60.40% 60% 47.00% 50% 44.34% Percentage Correct 43.12% 40% 30% 20% 10.48% 10% 0% ACG 201 ACG 201 ACG 201 ACG 201 ACG 201 ACG 201 ACG 201 ACG 201 ACG 201 ACG 201 ACG 201 ACG 201 ACG 201 ACG 201 ACG 201 ACG 201 ACG 201 ACG 201 S1 Q1 S1 Q2 S1 Q3 S1 Q4 S1 Q5 S1 Q6 S2 Q1 S2 Q2 S2 Q3 S2 Q4 S2 Q5 S2 Q6 S3 Q1 S3 Q2 S3 Q3 S3 Q4 S3 Q5 S3 Q6 ACG 203 AOL Content Knowledge Fall 2011 93.02% 95.58% 100% 90% 80% 100.00% 96.00% 86.79% 99.04% 92.08% 88.78% 97.12% 88.12% 89.13% 84.40% 87.76% 75.00% 64.58% 70% 55.34% 60% 59.22% 50% 40% 30% 20% 17.14% 10% 0% ACG 203 ACG 203 ACG 203 ACG 203 ACG 203 ACG 203 ACG 203 ACG 203 ACG 203 ACG 203 ACG 203 ACG 203 ACG 203 ACG 203 ACG 203 ACG 203 ACG 203 ACG 203 S1 Q1 S1 Q2 S1 Q3 S1 Q4 S1 Q5 S1 Q6 S2 Q1 S2 Q2 S2 Q3 S2 Q4 S2 Q5 S2 Q6 S3 Q1 S3 Q2 S3 Q3 S3 Q4 S3 Q5 S3 Q6 Percentage Correct BLA 361 AOL Content Knowledge Fall 2011 100% 90% 87.83% 80% 93.33% 87.74% 87.50% 84.16% 76.04% 72.53% 65.83% 70% 60% 98.94% 51.35% 55.34% 64.76% 56.64% 57.84% 53.64% Percentage Correct 45.05% 46.46% 50% 37.80% 40% 30% 20% 10% 0% BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 S1 Q1 S1 Q2 S1 Q3 S1 Q4 S1 Q5 S1 Q6 S2 Q1 S2 Q2 S2 Q3 S2 Q4 S2 Q5 S2 Q6 S3 Q1 S3 Q2 S3 Q3 S3 Q4 S3 Q5 S3 Q6 ECN 221 AOL Content Knowledge Fall 2011 100% 92.31% 86.84% 90% 86.02% 64.95% 70% 59.43% 60% 50% 66.67% 62.11% 57.58% 55.05% 51.46% 46.67% 38.39% 40% 30% Percentage Correct 75.00% 80% 23.08% 28.09% 27.36% 22.86% 27.47% 20% 10% 5.61% 0% ECN 221 ECN 221 ECN 221 ECN 221 ECN 221 ECN 221 ECN 221 ECN 221 ECN 221 ECN 221 ECN 221 ECN 221 ECN 221 ECN 221 ECN 221 ECN 221 ECN 221 ECN 221 ECN 221 S1 Q1 S1 Q2 S1 Q3 S1 Q4 S1 Q5 S1 Q6 S2 Q1 S2 Q2 S2 Q3 S2 Q4 S2 Q5 S2 Q6 S3 Q1 S3 Q2 S3 Q3 S3 Q3 S3 Q4 S3 Q5 S3 Q6 ECN 222 AOL Content Knowledge Fall 2011 94.79% 95.88% 100% 90% 80% 94.74% 88.03% 87.88% 81.13% 80.81% 78.45% 70% 45.78% 40.63% 40% 61.29% 60.82% 59.18% 57.39% 60% 50% Percentage Correct 73.27% 42.34% 31.13% 25.93% 30% 20% 10% 0% ECN 222 ECN 222 ECN 222 ECN 222 ECN 222 ECN 222 ECN 222 ECN 222 ECN 222 ECN 222 ECN 222 ECN 222 ECN 222 ECN 222 ECN 222 ECN 222 ECN 222 ECN 222 S1 Q1 S1 Q2 S1 Q3 S1 Q4 S1 Q5 S1 Q6 S2 Q1 S2 Q2 S2 Q3 S2 Q4 S2 Q5 S2 Q6 S3 Q1 S3 Q2 S3 Q3 S3 Q4 S3 Q5 S3 Q6 FIN 335 AOL Content Knowledge Fall 2011 100% 90% 80% 99.02% 99.00% 94.06% 93.14% 88.54% 82.61% 83.18% 79.41% 68.37% 70% 59.79% 54.74% 60% 48.94% 50% 40% 30% 20% 10% 43.62% 35.16% 28.18% 16.67% 9.17% 12.73% 0% FIN 335 FIN 335 FIN 335 FIN 335 FIN 335 FIN 335 FIN 335 FIN 335 FIN 335 FIN 335 FIN 335 FIN 335 FIN 335 FIN 335 FIN 335 FIN 335 FIN 335 FIN 335 S1 Q1 S1 Q2 S1 Q3 S1 Q4 S1 Q5 S1 Q6 S2 Q1 S2 Q2 S2 Q3 S2 Q4 S2 Q5 S2 Q6 S3 Q1 S3 Q2 S3 Q3 S3 Q4 S3 Q5 S3 Q6 Percentage Correct INB 300 AOL Content Knowledge Fall 2011 97.20% 100% 90% 75.23% 80% 66.02% 70% 93.94% 80.58% 69.52% 74.29% 93.14% 90.20% 85.58% 80.73% 79.59% 70.11% 64.36% 63.00% 62.63% 60% 50% Percentage Correct 43.56% 40% 30% 20% 10% 7.62% 0% INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 S1 Q1 S1 Q2 S1 Q3 S1 Q4 S1 Q5 S1 Q6 S2 Q1 S2 Q2 S2 Q3 S2 Q4 S2 Q5 S2 Q6 S3 Q1 S3 Q2 S3 Q3 S3 Q4 S3 Q5 S3 Q6 MGT 350 AOL Content Knowledge Fall 2011 100% 90% 80% 78.49% 73.87% 68.66% 69.61% 70% 60% 89.77% 88.66% 84.68% 57.00% 100.00% 93.10% 87.85% 85.29% 74.23% 68.93% 64.58% 53.40% Percentage Correct 56.52% 55.45% 50% 40% 30% 20% 10% 0% MGT 350 MGT 350 MGT 350 MGT 350 MGT 350 MGT 350 MGT 350 MGT 350 MGT 350 MGT 350 MGT 350 MGT 350 MGT 350 MGT 350 MGT 350 MGT 350 MGT 350 MGT 350 S1 Q1 S1 Q2 S1 Q3 S1 Q4 S1 Q5 S1 Q6 S2 Q1 S2 Q2 S2 Q3 S2 Q4 S2 Q5 S2 Q6 S3 Q1 S3 Q2 S3 Q3 S3 Q4 S3 Q5 S3 Q6 MIS 213 AOL Content Knowledge Fall 2011 100% 96.81% 94.29% 88.78% 90% 94.32% 81.18% 80% 69.16% 68.93% 70% 71.30% 64.42% 67.29% 60% 49.53% 45.45% 47.12% 50% Percentage Correct 42.35% 35.54% 40% 27.27% 30% 30.30% 20% 11.30% 10% 0% MIS 213 MIS 213 MIS 213 MIS 213 MIS 213 MIS 213 MIS 213 MIS 213 MIS 213 MIS 213 MIS 213 MIS 213 MIS 213 MIS 213 MIS 213 MIS 213 MIS 213 MIS 213 S1 Q1 S1 Q2 S1 Q3 S1 Q4 S1 Q5 S1 Q6 S2 Q1 S2 Q2 S2 Q3 S2 Q4 S2 Q5 S2 Q6 S3 Q1 S3 Q2 S3 Q3 S3 Q4 S3 Q5 S3 Q6 MKT 340 AOL Content Knowledge Fall 2011 100% 93.88% 89.42% 90% 80% 71.72% 52.53% 57.61% 87.16% 81.91% 76.09% 68.97% 70% 60% 90.27% 87.10% 83.33% 81.58% 59.60% 54.35% Percentage Correct 50% 40% 30% 38.10% 20.00% 20% 10% 5.21% 0% MKT 340 MKT 340 MKT 340 MKT 340 MKT 340 MKT 340 MKT 340 MKT 340 MKT 340 MKT 340 MKT 340 MKT 340 MKT 340 MKT 340 MKT 340 MKT 340 MKT 340 MKT 340 S1 Q1 S1 Q2 S1 Q3 S1 Q4 S1 Q5 S1 Q6 S2 Q1 S2 Q2 S2 Q3 S2 Q4 S2 Q5 S2 Q6 S3 Q1 S3 Q2 S3 Q3 S3 Q4 S3 Q5 S3 Q6 OPS 370 AOL Content Knowledge Fall 2011 100% 88.29% 90% 80% 72.73% 70.45% 72.53% 70.16% 61.32% 64.13% 70% 60% 51.61% 49.04% 50% 58.76% 60.95% Percentage Correct 53.33% 46.74% 38.18% 40% 30% 34.86% 21.90% 20% 10.58% 8.26% 10% 0% OPS 370 OPS 370 OPS 370 OPS 370 OPS 370 OPS 370 OPS 370 OPS 370 OPS 370 OPS 370 OPS 370 OPS 370 OPS 370 OPS 370 OPS 370 OPS 370 OPS 370 OPS 370 S1 Q1 S1 Q2 S1 Q3 S1 Q4 S1 Q5 S1 Q6 S2 Q1 S2 Q2 S2 Q3 S2 Q4 S2 Q5 S2 Q6 S3 Q1 S3 Q2 S3 Q3 S3 Q4 S3 Q5 S3 Q6 QMM 280 AOL Content Knowledge Fall 2011 100% 97.60% 100.00% 94.38% 92.79% 87.04% 89.69% 88.89% 90% 75.73% 80% 68.32% 70% 60.61% 60.98% 57.84% 60% 49.00% 50% 42.99% 40% 39.08% 32.95% 30% 34.26% 23.58% 20% 10% 0% QMM 280 S1 Q1 QMM 280 S1 Q2 QMM 280 S1 Q3 QMM 280 S1 Q4 QMM 280 S1 Q5 QMM 280 S1 Q6 QMM 280 S2 Q1 QMM 280 S2 Q2 QMM 280 S2 Q3 QMM 280 S2 Q4 QMM 280 S2 Q5 QMM 280 S2 Q6 QMM 280 S3 Q1 QMM 280 S3 Q2 QMM 280 S3 Q3 QMM 280 S3 Q4 QMM 280 S3 Q5 QMM 280 S3 Q6 Percentage Correct 2. Integration Integration Assessment Results as of May 2012 Analysis of Issues 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Pilot 07 Spr 08 Sum I 08 Fall 08 Spr 09 Sum I 09 Sum II Fall 09 (N=36) (N=29) (N=19) (N=36) (N=24) (N=7) 09 (N=5) (N=19) Spring Summer Summer Fall 2010 Spring Summer Fall 2011 Spring 2010 I 2010 II 2010 (N=101) 2011 I 2011 (N=80) 2012 (N=35) (N=6) (N=7) (N=38) (N=5) (N=114) Analysis Tools 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Pilot Spr 2008 Sum I Fall 2008 Spr 2009 Sum I 2007 (N=29) 2008 (N=36) (N=24) 2009 (N=36) (N=19) (N=7) Sum II Fall 2009 Spring Summer Summer Fall 2010 Spring Summer Fall 2011 Spring 2009 (N=19) 2010 I 2010 II 2010 (N=101) 2011 I 2011 (N=80) 2012 (N=5) (N=35) (N=6) (N=7) (N=38) (N=5) (N=114) Functional Unit Integration 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Pilot Spr 2008 Sum I Fall 2008 Spr 2009 Sum I 2007 (N=29) 2008 (N=36) (N=24) 2009 (N=36) (N=19) (N=7) Sum II Fall 2009 Spring Summer Summer Fall 2010 Spring Summer Fall 2011 Spring 2009 (N=19) 2010 I 2010 II 2010 (N=101) 2011 I 2011 (N=80) 2012 (N=5) (N=35) (N=6) (N=7) (N=38) (N=5) (N=114) Performance Outcomes 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Pilot Spr 2008 Sum I Fall 2008 Spr 2009 Sum I 2007 (N=29) 2008 (N=36) (N=24) 2009 (N=36) (N=19) (N=7) Sum II Fall 2009 Spring Summer Summer Fall 2010 Spring Summer Fall 2011 Spring 2009 (N=19) 2010 I 2010 II 2010 (N=101) 2011 I 2011 (N=80) 2012 (N=5) (N=35) (N=6) (N=7) (N=38) (N=5) (N=114) 3. Teamwork Teamwork Assessment Results as of May 2012 Attendance 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Conflict Resolution 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Decision Making 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Goals 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Meetings 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Member Support 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Participation 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Roles 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Success 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 4. Leadership Leadership Assessment Results as of May 2012 Facilitation 100% 90% 80% 70% 60% 50% 0 40% 2 30% 4 20% 10% 0% Summer Spring Summer Summer Fall Spring Summer Summer Fall Spring Summer Summer Fall Spring Summer Fall Spring II 2007 2008 I 2008 II 2008 2008 2009 I 2009 II 2009 2009 2010 I 2010 II 2010 2010 2011 I 2011 2011 2012 (N=632) (N=100) (N=101) (N=101) (N=728) (N=953) (N=93) (N=13) (N=353) (N=988) (N=91) (N=32) (N=447) (N=468) (N=18) (N=468) (N=627) Guidance 100% 90% 80% 70% 60% 50% 0 40% 2 30% 4 20% 10% 0% Summer Spring Summer Summer Fall Spring Summer Summer Fall Spring Summer Summer Fall Spring Summer Fall Spring II 2007 2008 I 2008 II 2008 2008 2009 I 2009 II 2009 2009 2010 I 2010 II 2010 2010 2011 I 2011 2011 2012 (N=632) (N=100) (N=101) (N=101) (N=728) (N=953) (N=93) (N=13) (N=353) (N=988) (N=91) (N=32) (N=447) (N=468) (N=18) (N=468) (N=627) Motivation 100% 90% 80% 70% 60% 50% 0 40% 2 30% 4 20% 10% 0% Summer Spring Summer Summer Fall Spring Summer Summer Fall Spring Summer Summer Fall Spring Summer Fall Spring II 2007 2008 I 2008 II 2008 2008 2009 I 2009 II 2009 2009 2010 I 2010 II 2010 2010 2011 I 2011 2011 2012 (N=632) (N=100) (N=101) (N=101) (N=728) (N=953) (N=93) (N=13) (N=353) (N=988) (N=91) (N=32) (N=447) (N=468) (N=18) (N=468) (N=627) Team Building 100% 90% 80% 70% 60% 50% 0 40% 2 30% 4 20% 10% 0% Summer Spring SummerSummer Fall Spring SummerSummer Fall Spring SummerSummer Fall Spring Summer Fall Spring II 2007 2008 I 2008 II 2008 2008 2009 I 2009 II 2009 2009 2010 I 2010 II 2010 2010 2011 I 2011 2011 2012 (N=632) (N=100) (N=101) (N=101) (N=728) (N=953) (N=93) (N=13) (N=353) (N=988) (N=91) (N=32) (N=447) (N=468) (N=18) (N=468) (N=627) Vision 100% 90% 80% 70% 60% 50% 0 40% 2 30% 4 20% 10% 0% Summer Spring SummerSummer Fall Spring SummerSummer Fall Spring SummerSummer Fall Spring Summer Fall Spring II 2007 2008 I 2008 II 2008 2008 2009 I 2009 II 2009 2009 2010 I 2010 II 2010 2010 2011 I 2011 2011 2012 (N=632) (N=100) (N=101) (N=101) (N=728) (N=953) (N=93) (N=13) (N=353) (N=988) (N=91) (N=32) (N=447) (N=468) (N=18) (N=468) (N=627) Appendix B: BSBA SLO2 Findings 1. Problem Solving Assessment Results as of February 2012 Problem Solving Assessment Results 100% 90% 97% 85% 90% 89% 83% 82% 80% 71% 88% 75% Fall 2009 % with Correct Answer (N=83) 70% Fall 2010 % with Correct Answer (N=166) 54% 56% 56% 60% 50% 40% Spring 2011 % with Correct Answer (N=72) 30% 20% 10% 0% Defining and Understanding the Problem Uses Information Appropriately Applies Appropriate Procedures Answers the Problem 2. Critical Thinking Assessment Results as of February 2012 Critical Thinking Assessment Results 100% 85% 90% 80% 90% 78% 70% 63% 68% Fall 2009 % with Correct Answer (N=83) 63% 57% 60% 50% 54% 49% 40% Fall 2010 % with Correct Answer (N=166) Spring 2011 % with Correct Answer (N=72) 30% 20% 10% 0% Defining and Understanding the Issue Considers Multiple Perspectives Evaluates Evidence Appendix C: BSBA SLO3 Findings 1. Written Communication Assessment Results as of June 2012 Sample Current Assessment Summer 2012 MKT 343 Percentage of Essays Without Errors 100% 80% 60% 40% 20% Summer 2012 (N=24) 45.83% 25.00% 12.50% 4.17% 0% Grammar Usage Average holistic score for this class was 4.38. Mechanics Style Past Essay Assessment Trends 2. Oral Communication Assessment Results as of May 2012 Content 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Pilot Spring Summer Fall Spring Summer Summer Fall Spring Summer Summer Fall Spring Summer Fall Spring 2007 2008 I 2008 2008 2009 I 2009 II 2009 2009 2010 I 2010 II 2010 2010 2011 I 2011 2011 2012 (N=27) (N=42) (N=21) (N=25) (N=32) (N=7) (N=5) (N=17) (N=33) (N=6) (N=7) (N=13) (N=35) (N=9) (N=83) (N=113) Delivery 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Pilot Spring Summer Fall Spring Summer Summer Fall Spring Summer Summer Fall Spring Summer Fall Spring 2007 2008 I 2008 2008 2009 I 2009 II 2009 2009 2010 I 2010 II 2010 2010 2011 I 2011 2011 2012 (N=27) (N=42) (N=21) (N=25) (N=32) (N=7) (N=5) (N=17) (N=33) (N=6) (N=7) (N=13) (N=35) (N=9) (N=83) (N=113) Mechanics 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Pilot Spring Summer Fall 2007 2008 I 2008 2008 (N=27) (N=42) (N=21) (N=7) Spring Summer Summer Fall Spring Summer Summer Fall Spring Summer Fall Spring 2009 I 2009 II 2009 2009 2010 I 2010 II 2010 2010 2011 I 2011 2011 2012 (N=32) (N=7) (N=5) (N=17) (N=33) (N=6) (N=7) (N=13) (N=35) (N=9) (N=83) (N=113) Organization 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 0 2 4 Pilot Spring Summer Fall Spring Summer Summer Fall Spring Summer Summer Fall Spring Summer Fall Spring 2007 2008 I 2008 2008 2009 I 2009 II 2009 2009 2010 I 2010 II 2010 2010 2011 I 2011 2011 2012 (N=27) (N=42) (N=21) (N=25) (N=32) (N=7) (N=5) (N=17) (N=33) (N=6) (N=7) (N=13) (N=35) (N=9) (N=83) (N=113) Appendix D: BSBA SLO4 Findings 1. Ethics Assessment Results as of December 2011 The AOL Plan called for social responsibility to be captured in the content knowledge multiple choice assessments. Additional ethics questions were added to the new assessment effective fall 2011. Data is being collected. Ethics AOL Content Knowledge Fall 2011 100% 90% 80% 98.10% 93.20% 97.00% 90.82% 100% 93.14% 91.60% 85.06% 77.78% 70.76% 73.45% 70% 60% 50% 98.95% 83% 95% 91.58% 99.06% 96% 89.91% 89.22% 89% 89.01% 87.50% 84.31% 76.99% 65.71% 65.42% 63.81% 56.07% Percentage Correct 53.91% 46.59% 40% 42.42% 40% 30% 20% 10% 0% 16.16% 2. Social Responsibility Assessment Results as of December 2011 The AOL Plan called for social responsibility to be captured in the content knowledge multiple choice assessments. Additional social responsibility and diversity questions were added to the new assessment effective fall 2011. Data is being collected. Social Responsibility AOL Content Knowledge Fall 2011 100% 94.06% 93.94% 87.96% 90% 80% 97.17% 77.48% 74.76% 68.75% 70% 85.71% 80.00% 78.70% 77.14% 70.41% 69.79% 59.34% 50% 42.72% 40% 81.98% 72.04% 60% 30% 79.05% 63.37% 48.62% 43.93% 30.48% 34.86% 21.51% 20% 10% 0% SR S1 SR S1 SR S1 SR S1 SR S1 SR S1 SR S1 SR S1 SR S2 SR S2 SR S2 SR S2 SR S2 SR S2 SR S2 SR S2 SR S3 SR S3 SR S3 SR S3 SR S3 SR S3 SR S3 SR S3 BLA BLA INB Q3 INB Q4 MGT MGT MKT MKT BLA BLA INB Q3 INB Q4 MGT MGT MKT MKT BLA BLA INB Q3 INB Q4 MGT MGT MKT MKT Q1 Q2 Q5 Q6 Q7 Q8 Q1 Q2 Q5 Q6 Q7 Q8 Q1 Q2 Q5 Q6 Q7 Q8 Percentage Correct 3. Diversity Assessment Results as of December 2011 The AOL Plan called for social responsibility to be captured in the content knowledge multiple choice assessments. Additional social responsibility and diversity questions were added to the new assessment effective fall 2011. Data is being collected. Diversity AOL Content Knowledge Fall 2011 100% 99.07% 100% 92.92% 90.38% 90% 77.88% 80% 70% 60% 66.02% 59.78% 57.14% 100% 96.23% 89.90% 85.39% 91.21% 87.91% 77.36% 76.58% 64.89% 69.15% 62.75% 75.90% 72.81% 61.29% 52.38% 50% 39.64% 38.38% 40% 30% 20.83% 19.53% 20% 10% 0% DIV DIV S1 S1 BLA BLA Q1 Q2 DIV S1 INB Q3 DIV S1 INB Q4 DIV DIV DIV DIV DIV DIV DIV S1 S1 S1 S1 S1 S2 S2 INB MGT MGT MKT MKT BLA BLA Q5 Q6 Q7 Q8 Q9 Q1 Q2 DIV S2 INB Q3 DIV S2 INB Q4 DIV DIV DIV DIV DIV DIV DIV S2 S2 S2 S2 S2 S3 S3 INB MGT MGT MKT MKT BLA BLA Q5 Q6 Q7 Q8 Q9 Q1 Q2 DIV S3 INB Q3 DIV S3 INB Q4 DIV DIV DIV DIV DIV S3 S3 S3 S3 S3 INB MGT MGT MKT MKT Q5 Q6 Q7 Q8 Q9 Percentage Correct 4. Legal Issues Assessment Results as of December 2011 BLA 361 Percentage Correct 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 70.40% 68.03% 59.11% Avg. % Correct Spring 2010 Fall 2010 Fall 2011 BLA 361 AOL Content Knowledge Fall 2011 100% 90% 80% 87.83% 87.74% 87.50% 50% 40% 98.94% 84.16% 76.04% 72.53% 65.83% 70% 60% 93.33% 51.35% 55.34% 64.76% 56.64% 57.84% 53.64% 45.05% 46.46% 37.80% 30% 20% 10% 0% BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 BLA 361 S1 Q1 S1 Q2 S1 Q3 S1 Q4 S1 Q5 S1 Q6 S2 Q1 S2 Q2 S2 Q3 S2 Q4 S2 Q5 S2 Q6 S3 Q1 S3 Q2 S3 Q3 S3 Q4 S3 Q5 S3 Q6 Percentage Correct BLA 361 Spring 2008 (N=149) Percentage Correct 100% Summer II 2008 (N=23) Fall 2008 (N=95) 80% Spring 2009 (N=80) 60% Summer 2009 (N=31) 40% Fall 2009 (N=25) Spring 2010 (N=25) 20% Summer 2010 (N=26) 0% 1 2 3 Question No. 4 5 Fall 2010 (N=45) Note: Qs revised before Fall 2009. Appendix E: BSBA SLO5 Findings Global Business Content Knowledge Assessment Results as of December 2011 INB 300 Percentage Correct 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 72.00% 75.11% 72.10% Avg. % Correct Spring 2010 Fall 2010 Fall 2011 97.20% 100% 90% 75.23% 80% 66.02% 70% Global Business AOL Content Knowledge Fall 2011 93.94% 80.58% 69.52% 74.29% 93.14% 90.20% 85.58% 80.73% 79.59% 70.11% 64.36% 63.00% 62.63% 60% Percentage Correct 43.56% 50% 40% 30% 20% 10% 7.62% 0% INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 INB 300 S1 Q1 S1 Q2 S1 Q3 S1 Q4 S1 Q5 S1 Q6 S2 Q1 S2 Q2 S2 Q3 S2 Q4 S2 Q5 S2 Q6 S3 Q1 S3 Q2 S3 Q3 S3 Q4 S3 Q5 S3 Q6 Percentage Correct Global Business Spring 2008 (N=149) Summer II 2008 (N=23) Fall 2008 (N=95) Spring 2009 (N=80) Summer 2009 (N=31) Fall 2009 (N=25) Spring 2010 (N=25) Summer 2010 (N=26) Fall 2010 (N=45) 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% 1 2 3 Question No. 4 5 Note: Q1 revised before Spring 2009.