Assessment Summaries of ACBSP Accredited Programs College of Management 2013‐2014

advertisement
 AssessmentSummariesof
ACBSPAccreditedPrograms
CollegeofManagement
2013‐2014 2013-14
B.S. in Business Administration
Program Directors: Mark Fenton
Total Student Enrollment: 719
Description of Methods
1. Direct Assessments
a. Peregrine CPC Exam
b. Multi-section Common Final Exam
c. Capstone Reviews
d. Co-op Employer Evaluations
2. Indirect Assessments
a. PRC Surveys (student, faculty, board member) and Career Services Employment Data
b. PARQ Alumni Follow-up (program, employer, student)
c. Co-op/Internship Self-Assessment
d. Program Facts and Enrollment
Results
3. The PRC Key Instructors Survey (n=11/16) asked key staff to rate on a 5 point scale (5 being
strongly agree), how they felt about 13 items across multiple areas. Mean scores ranged from
3.55 to 4.55 with Departments schedule an adequate number of course sections being rated
lowest and Program Director’s leadership is satisfactory as highest.
4. The PRC Student Survey (n=69/376) asked junior and senior students to rate on a 5 point scale
(5 being strongly agree), how they felt about 20 items across multiple areas. Mean scores ranged
from 3.42 to 4.22 with The coursework in ethnic studies being rated lowest and Instructors in my
program are accessible for help outside of regular class time as highest.
5. The One-year Alumni Follow-Up Survey (n=28/163) asked alumni to rate on a 5 point scale (5
being excellent), how prepared they felt on 14 items. Mean scores ranged from 3.1 to 4.1 with
Economics and International/global business being rated lowest and Marketing as highest.
6. Charts showing CPC results indicated that across 15 categories, scores ranged from very low to
better than average with most ratings falling in the close to or better than average range.
7. For the Student Co-Op Employer Evaluation – 98% of employers said they would hire their
student again.
Interpretation
8. Student Co-Op Employer Evaluation data indicates, in general, employers were well satisfied
with BSBA co-op students.
Dissemination
9. Program faculty, deans, administration, BSBA Advisory Board
Program Improvements
10. Program expanding the number of external advisory board members. Two new external
members and one internal new member have joined the advisory board. More frequent meetings
are also scheduled.
1
2013-14
11. In Fall 13’ Management Ethics was implemented. The new course BUMGT-235 (Management
Ethics) has been well received by students and the long-term impact will be determined via
future assessments.
12. Selecting an assessment coordinator has clearly strengthened the program. Faculty have been
adapting common rubrics to have more uniform assessments.
13. The Advisory Board is now made up of a majority of business and industry professionals.
Plans for Improvement
14. Expand the size of the BSBA Advisory Board to include more business and industry
professionals.
15. More use of assessment rubrics on writing and oral presentations.
16. Increase the number of students from other countries.
17. Continue to encourage students to complete a study abroad opportunity with a goal of 20% of
students doing at least one study abroad.
18. Improve marketing efforts to increasing the number of women and minorities in the program.
19. Continue to complete course revisions with the hopes of completing all by 2016.
2
2013-14
B.S. in Management
Program Directors: Wendy Dittmann
Total Student Enrollment:
Description of Methods
1. Direct Assessments
a. Peregrine Common Professional Competencies (CPC) exam
b. Locally designed quizzes, tests, and inventories
c. Portfolio artifacts
d. Capstone projects
2. Indirect Assessments
a. Employment data (Annual Employment Report)
b. Program Student Survey
c. PRC Survey
d. Alumni Follow up Survey
e. Enrollment, Retention Graduation Rates (Program Facts)
Results
3. For 12-13 graduates, there was a 97% employment rate with a median salary of $56,000 reported.
4. For 13-14 program graduate applicants rated the importance of and their preparation on the program objectives on
a 5-point scale (1=low, 5=high). For importance, mean scores ranged from 3.8 – 4.3 and for preparation, mean
scores ranged from 3.7 – 4.3.
5. For 13-14, Management student scores fell in the Average range on the Peregrine CPC exam.
6. On the formative assessment in INMGT-200, students performed near or above the 75% goal.
7. On the portfolio for INMGT-460, 90% of Fall 2013 and 100% of Spring 2014 students scored above 90%.
8. The percentage of students scoring above the reasonable to exceptional rank on the business plan rubric was 93%
in Fall 2013 and 91% in Spring 2014.
9. Green Belt certification was awarded to 10 students in the Quality Capstone.
Interpretation
10. Graduates of the B.S. in Management are employed at a rate consistent with other graduates of UW-Stout, 97%,
and earn among the four highest average salaries.
11. Based on the PRC Survey, the program continues to show strengths in enrollment and outcomes (graduates).
12. Five year graduates responding to the [Alumni Follow-up] survey have consistently valued their Stout and BSM
degree higher than one-year graduates.
13. BSM scores [on the Peregrine Exams] are slightly higher than other ACBSP accredited Stout programs and at par
with other online ACBSP accredited programs.
Dissemination
14. COM Associate Dean, COM Assessment Coordinator, Program Advisory Board and UW Information Portal.
Program Improvements
15. Created assessment map of program objectives.
16. Formative assessment added in INMGT 200.
17. Continuation of Peregrine CPC Test to capstone classes.
18. Provided more complete interpretation of assessment results.
Plans for Improvement
19. Encourage the use of developed rubrics, written and oral communication, by faculty within college.
20. Implement assessment in BUACT-206.
21. Develop new assessment measure in INMGT-460.
22. Collect data points over time.
3
2013-14
B.S. in Retail Merchandising and Management
Program Directors: Adel Mekraz
Total Student Enrollment: 273
Description of Methods
1. Direct Assessments
a. Course embedded assessments
b. Peregrine CPC Exam
c. Retail Company Profile Oral Presentations
d. Employer Evaluation of a Co-op Student
2. Indirect Assessments
a. Career Services Annual Placement Report
b. PRC Student, Faculty, and Advisory Board Surveys
c. PARQ Alumni Follow-Up (General and Program Specific)
d. Feedback from Industry Advisors
e. Program Facts
Results
3. Ninety-eight percent of 2012-13 graduates were employed with an average salary of $41,000.
4. Employer evaluations of coop students on 17 items had overall scores ranging from 3.95-4.75 with Initiative
being the lowest and Team Work being the highest rated items. Overall, corporate interns received higher
evaluations than store interns, with an average score of 4.11 compared to 3.93.
5. BUACT-206 Final: The average score (N=45) for RMM majors in 2013-14 was 66.95%.
6. Merchandise Planning & Control Pre/Post: For the 168 students who took the test, mean scores improved 59.05
points from 11.83 (pre) to 70.88 (post).
7. Peregrine CPC Exam: The mean score was 47.53 in FA13 and 49.50 in SP14 which places students in the average
category.
8. Retail Company Profile Oral Presentation: Students scored better in oral communications in person mean scores
range from 3.5 to 3.8 and online mean scores range from 3.3 to 3.5.
Interpretation
9. The 10% decline in enrollment is a concern.
10. Mean scores on the alumni follow-up survey were on the low end of the spectrum compared to other programs at
UW-Stout. This may be due to the visual merchandising lab lacking particular technology and software that some
competitors have.
11. RMM students scored better in oral communication skills in the in-person course section than they did in the
online section. It is not clear at this point what the reason is other than the perhaps because of the difference in
the method of course delivery.
Dissemination
12. RMM Advisory Board, external stakeholders via the Stout website.
Program Improvements
13. A new rubric has been introduced this year for the measurement of Oral Communication Skills.
14. Program directors and assessment coordinator all have been working together on the development of a rubric
which will be used to measure critical thinking, problem solving and analytical skills.
15. Expanded implementation of direct assessment methods to reach more RMM students.
16. Starting the 2013-2014 academic year, the BURTL-451 Retail Practicum II course has started using the same
measurement instrument that was used to assess student performance in the senior-level co-op experience.
Plans for Improvement
17. RMM program will begin assessing oral communication skills at the freshman and sophomore levels.
18. The plan is for the RMM program to start using critical thinking rubric to assess critical thinking skills during the
2015-2016 academic year.
4
2013-14
B.S. in Supply Chain Management
Program Directors: Gene Gutman
Total Student Enrollment: 69
Description of Methods
1. Direct Assessments
a. APICS Certification Exams (Supply Chain Basics; Master Planning of Resources)
b. Course embedded assessments
c. Capstone project evaluation
d. Co-op employer evaluation
2. Indirect Assessments
a. Career Services data (employment reports; co-op salary information)
b. Student co-op self-assessment
c. PRC Surveys
d. Alumni Follow-Up Survey
e. Program Facts
Results
3. Average hourly wage for co-op students was $16.53 per hour; Based on informal reporting, annual
starting salaries ranged from $50,000 - $60,000 per year for SCM graduates in 2012-13.
4. Student co-op self-assessment: On a 5-point scale (1-strongly disagree, 5=strongly agree), the average
rating across questions was 4.72. All students would recommend their co-op to others.
5. APICS Exams: 75% (9/12) students passed the Supply Chain Basics Exam, which is even with the
national average. 67% (8/12) students passed the Master Planning of Resources exam which is slightly
below the national average.
6. BUACT-206 Exam: SCM students (n = 21) scores averaged 75.44%, which is 6.08% above the average
across COM.
7. Capstone Projects: out of 21 students 3 students were rated Outstanding, 9 were rated Above Average,
and 5 were rated Average. No students were rated Not Acceptable.
8. Co-op employer student evaluation: 100% of employers gave ratings of Satisfied or better; 11 of 12
employers said they would hire the person again.
Interpretation
9. SCM students are in high demand and their skills are relevant as evidenced by the hourly wage of co-op
students.
10. Based on student feedback to the Program Director, all students are employed in a field directly related
to Supply Chain Management.
11. Enrollment has increased at a compound annual growth rate of 33.1% since the program started in 2010.
Strong job demand in industry, capable graduates, and high salaries are driving enrollment numbers.
12. Performance has improved significantly during the last year on the APICS Basics of Supply Chain
Management exam and the APICS master Planning of Resources exam.
13. SCM students demonstrated a higher comprehension of accounting concepts that other majors due to the
higher admission standards and graduation GPA requirements for the SCM major.
14. The Advisory Board treats the capstone project review as if they were reviewing a project in their
business. Assessment ratings indicate students can diagnose, design and optimize a supply chain.
15. Based on FA2013 and SP2014 data, student performance in co-ops is strong, employers are very
satisfied and students value the experience.
5
2013-14
Dissemination
16. Dean’s Office, COM, Advisory Board, faculty, Department Chairs
Program Improvements
17. The number of APICS exams were expanded from one to two for the year.
18. The instructor of INMGT-405 created videos for students to review prior to class, which improved
student learning as evidenced by the improved APICS test scores.
19. Course mapping to learning objectives has started to align assessment measures with program
objectives.
20. Developed and expanded rubrics, piloted courses, and created program revisions.
21. Implemented Advisory Board Members as mentors.
22. Recommendations from last year’s AIM Report were addressed.
Plans for Improvement
23. Implement program revisions and additional foundation classes.
24. Work with COM Associate Dean and Department Chairs to improve learning in foundation classes.
25. Develop and implement a pilot for BUSCM-341 Global Supply Chain Modeling and Optimization with
a goal to offer it Spring 2015.
26. Continue to improve student learning in INMGT-305/INMGT-405 to impact APICS exams pass rate.
27. Expand assessment of co-op evaluations.
28. Begin to collect and analyze survey data from graduates from the prior year.
29. Expand the rubric to assess BUSCM-460 Supply Chain Design I Capstone Project Evaluation and
BUSCM-461 Capstone Project Evaluation.
6
2013-14
M.S. in Operations and Supply Management
Program Directors: James Keyes
Total Student Enrollment:
Description of Methods
1. Direct Assessments
a. Industry Certification Tests (APICS Certification Exams)
b. Capstone Projects (Plan B paper)
c. Team / Group Projects and Presentations
2. Indirect Assessments
a.
b.
c.
d.
PRC Student, Faculty, and Advisory Board Surveys
PARQ Alumni Follow-up Survey (general, program specific, and employer)
Enrollment by Segmented Groups, Graduation Rates, and GPA from program facts
Student Survey on Importance and Preparation
Results
3. PRC: Student Survey mean results range from 3.27 to 4.50. Faculty Survey mean results range from 3.00 to
4.
5.
6.
7.
8.
4.75. (1=strongly disagree; 5=strongly agree). The Advisory Board Survey indicates agreement that they have the
opportunity to make recommendations and have an impact on program decisions.
PARQ Alumni Follow-up (n=3): Mean importance rating = 3.80, Mean preparation rating = 3.00 and Mean
overall benefit to career advancement = 3.50. All ratings were on a 5-point scale.
There were 49 new students in 2013-14 in the MS OSM program. The median amount of time to graduate was
seven semesters. The mean undergraduate GPA for these students was 3.02.
Student Survey on Importance and Preparation: Mean for students’ perception of the degree of importance for
each objective = 4.53, Mean for degree of preparation of objectives = 3.95, Mean for students’ perception of the
overall benefit of the program = 4.17. All ratings were on a 5-point scale.
73% (11 out of 15) of students passed the APICS Basics of Supply Chain Management certification exam. 40%
(6 out of 15) of students passed the APICS Master Planning of Resources (MPR) certification exam. Students in
the MS OSM program underperformed on the MPR compared to the national mean pass rate.
All 9 students completed the Capstone Project (Plan B Paper) at an acceptable level for 2013-14.
Interpretation
9. Students reported that the program has good program direction and instructors, variety of classes and content, and
the practical application to the industry. Student identified the weaknesses of the program to include too much
focus on group/team projects and not enough on-campus courses.
10. The faculty and advisory board identified strengths of the program included broad course offerings and good job
outlook after graduation. The weaknesses reported by the instructors include the need for more courses and more
assistance to international students. The advisory board reported a need to increase the pace of graduation time
and expand the program market.
11. The alumni completing the PARQ survey had overall positive responses and showed that the objectives of the
program have importance and relevance in their careers.
12. The enrollment of students in the MS OSM program has increased again this year, continuing a four year trend.
Lack of a marketing plan is restricting the enrollment opportunities.
13. The Student Survey on Importance and Preparation response score means for the past several years is showing
that the degree of importance is trending in a positive directions. This indicates that the MS OSM program is
delivering increasingly important topical coverage. However the scores from the survey this year may indicate
that students are not feeling as prepared as they have been in previous years, which may indicate that the program
needs to evaluate how to better prepare students for a career in operations management.
Dissemination
14. COM Associate Dean, COM Assessment Coordinator, and the MS OSM Advisory Board. The report will also be
posted on the UW-Stout website.
7
2013-14
Program Improvements
15. Developed an assessment rubric for the Plan B papers.
16. Developed an evaluation system to measure student success in completing the MS OSM program.
17. Began surveying students at the completion of their coursework.
18. Developed a survey to measure the impact and performance of students’ activity in INMGT 640 Lean Enterprise.
The survey measures the impact of the students’ work.
Plans for Improvement
19. Implement the use of the Lean Enterprise impact survey starting in the FA2014.
20. Review the use of APICS exams as an external assessment at the advisory board SP2015 meeting.
8
Download