Motlow State Community College
Action Plan & Outcome Assessment Report for Institutional Effectiveness
Planning Year: July 1, 2015 – June 30, 2016
Assessing Year: July 1, 2014 – June 30, 2015
Unit: Career Readiness
Related Strategic Goal:
3.1 Monitor and improve the effectiveness of educational programs and services.
Action Plan #: CARE-01
Action Plan Title: Mechatronics Certificate of Credit Program Exit Examination
Desired Outcome: Students in the Mechatronics Certificate of Credit program of study will achieve a
minimum mean of 75 percent on the Mechatronics Certificate of Credit Program Exit Examination.
Description of Action Plan and Related Activities:
The purpose of the Mechatronics Certificate of Credit Program Exit Examination is to measure program
learning outcomes and examine basic competencies expected of students completing a 16 semester
credit hour Mechatronics Certificate of Credit. The program of study is comprised of four different Level
1 Mechatronics courses: MECH 1100, Electrical Components; MECH 1200, Mechanical Components and
Electrical Drives; MECH 1300, (Electro) Pneumatic and Hydraulic Control Circuits; and MECH 1500,
Digital Fundamentals and Programmable Logic Controllers.
The test is administered annually at the end of each spring semester to all Mechatronics students who
have completed the necessary 16 semester credit hours required for the certificate. The results of each
test are retained and evaluated by the Mechatronics faculty and the Department Chair for Career
Readiness to determine if the expected outcome was achieved. Predicated on each year’s results,
student performance on the examination will be evaluated and corrective action taken to ensure that
course content is applicable and appropriate, and that the proper emphasis is being placed on course
material/content pertaining to the expected program and student learning outcomes. As necessary,
course material/content will be modified and/or the proper instructional emphasis will be applied in the
applicable areas to ensure the accomplishment of the established learning outcomes.
A significant step in the evaluation process will be to complete a detail question analysis to ensure that
the examination questions are adequately measuring the required expected learning outcomes. As
necessary, specific examination questions, course syllabi, course outlines, and/or classroom
management and instructional techniques will be adjusted and modified to accommodate the expected
outcomes.
The Exit Examination consists of 60 multiple choice questions developed from each of the four MECH
courses and matched to the applicable learning outcomes as indicated by the rubrics depicted in the
following table, and as defined in the Career Readiness Department Outcomes Assessment and Program
Improvement Plan and Institutional Effectiveness Plan.
Courses
Strategic
Planning
Priorities
& Goals
Q3.1
General
Learning
Outcomes
(Rubrics)
GLO1-GLO4
Program
learning
Outcomes
(Rubrics)
PLO1-PLO7
MECH
1200
Q3.1
GLO1-GLO4
PLO1-PLO7
MECH
1300
Q3.1
GLO1-GLO4
PLO1-PLO7
MECH
1500
Q3.1
GLO1-GLO4
PLO1-PLO7
MECH
1100
Student
Learning
Outcomes
(Rubrics)
SLO1
SLO2
SLO3
SLO4
SLO5
SLO6
SLO7
SLO8
SLO9
SLO10
SLO11
SLO12
SLO13
SLO14
SLO15
SLO16
SLO17
SLO18
SLO19
SLO20
SLO21
SLO22
SLO23
SLO24
SLO25
SLO26
SLO27
SLO28
SLO29
SLO30
SLO31
SLO32
SLO33
SLO34
SLO35
SLO36
SLO37
SLO38
SLO39
SLO40
SLO41
Program Exit
Examination
Questions
Assessment
Results
11,42
27
14, 58
2
3,55, 57
1,14
2,34
15,59
41,51,57,59
30
4,5
12,26
28,33
4,5,50
6
32
17,33,53
29,54
40
31
16
20
21
22
35
52
7
25
24,36
8,56
38
11,13,39
44
45,51
43,56
23
45,48,60
19,49
18,46
18,47
9,10,37
The Mechatronics Certificate of Credit Program Exit Examination will be administered the first time in
the spring 2012 semester
Team Members: Director of Career Readiness and Mechatronics Instructors
Timeline: Annual upon completion of level 1 courses by students
Est. Cost: $50
Budgeted: Included in current budget
Evidence of Success: Mechatronics Certificate of Credit Program Exit Examination results will show that
the students completing the exit examination achieved a minimum mean of 75%.
Current Status: On Schedule
Assessment of Fall 2014 thru spring 2015 Mechatronic Students level 1 Rev 3
Class Group exams took place on end of fall 2014 & spring 2015 semester. A total of fifty-eight students
completed the four Mechatronics courses for Level 1 Certification in Fall 2014 & Spring 2015 semesters.
The Control group average (fall 13- spring 14) was 77.4%. Fifty-eight students were available to take the
comprehensive level 1 exam. The fall 2014 and spring 2015 group average was 71%.
Results shows a 6.4 % decline and 4% below the new 75% desired target. The desired outcome was not
met.
Analysis of Control group: After doing a detail review of the comprehensive exam data, two points
standout.
First Point: The student averages were the lowest in the first 2 courses of the series.
Calendar between f13/s14 & f14/s15
Course
Course #
Name
% improvement
MECH
1100
Electrical
-10.2
MECH
1200
Mechanical
-7.2
MECH
1300
Fluid Power
-6.6
MECH
1500
PLC
-3.4
Second Point: Now 3 of the 4 courses are not meeting the new target of 75% (only MECH 1500 is of
78.6% which is the last course the students take before the comprehensive exam)
Results shows a Decline in all classes from the previous year.
Assessment of Fall 2013 thru Spring 2014 Mechatronic Students level 1 Rev 2
Class Group exams took place on end of fall 2013 & spring 2014 semester. A total of fifty-five students
completed the four Mechatronics courses for Level 1 Certification in Fall 2012 & Spring 2013 semesters.
The Control group average was 64%. Fifty-five students were available to take the comprehensive level 1
exam. The fall 2012 and spring 2013 group average was 77.4%.
Results shows a 13.4% improvement and achieving 7.4% above the 70% desired outcome. The desired
outcome was met.
Analysis of Control group: After doing a detail review of the comprehensive exam data, two points
standout.
First Point: The student averages were the lowest in the first 2 courses of the series with MECH 1100 &
MECH 1200 being within 2% of each other.
Course #
MECH
1100
MECH
1200
MECH
1300
MECH
1500
Course Name
%
improvement
Electrical
21
Mechanical
15
Fluid Power
13.6
PLC
2.7
Second Point: The MECH 1100 course uses more math applications than the other 3 courses.
Results shows a 21% improvement in MECH 1100.
Third Point: MECH 1100 & MECH 1200 scores are now performing over 70% for the Fall 2013 & Spring
2014. Results shows a 70.3% in MECH 1100 and 72% in MECH 1200.
Assessment of Fall 2012 thru Spring 2013 Mechatronic Students level 1 Rev 2
Class Group exams took place on end of fall 2012 & spring 2013 semester. A total of fifty-six students
completed the four Mechatronics courses for Level 1 Certification in Fall 2012 & Spring 2013 semesters.
The Control group average was 64%. Fifty-three students were available to take the comprehensive level
1 exam. The fall 2012 and spring 2013 group average was 79%. Results shows a 15% improvement and
achieving 9% above the 70% desired outcome.
Analysis of Control group: After doing a detail review of the comprehensive exam data, two points
standout.
First Point: The student averages were the lowest in the first 2 courses of the series with MECH 1100 &
MECH 1200 being within .2% of each other.
Course #
MECH
1100
MECH
1200
MECH
1300
MECH
1500
Course Name
%
improvement
Electrical
19.8
Mechanical
12
Fluid Power
17
PLC
7.8
Second Point: The MECH 1100 course uses more math applications than the other 3 courses. Results
shows a 19.8% improvement in MECH 1100.
Assessment of Spring 2012 Mechatronic Students level 1 Rev 1
Class Group exam took place on April 26th, 2012. A total of eight students completed the four
Mechatronics courses for Level 1 Certification in Spring Semester 2012. The Control group
average was 64%.
Chart 1: (Grade %)
100
83
82
Level 1 comprehensive exam overall grade
75
80
57
60
58
52
64
55
52
40
20
0
Student A Student B Student C Student D Student E Student F Student G Student H
2012 Spring results
Class
Average
Analysis of Control group: After doing a detail review of the comprehensive exam data, two
points standout.
First Point: The student averages were the lowest in the first 2 courses of the series.
Chart 2: (Grade %)
Individual course average on Comprehensive Exam
100
Grade % 50
81
67
49
57
1100
1200
0
1300
1500
2012 spring results by individual cousre average
Second Point: The MECH 1100 course uses more math applications than the other 3 courses.
Refer to Chart 2 and Chart 3 graph.
Chart 3
Electronics 1100 comprehensive
exam score
80.0
60.0
Grade % 40.0
20.0
0.0
70.6 70.6
64.7
41.2
41.2
17.6
2012 spring results
41.2 47.1
49
Needed Changes:
The results of implementing described changes for Mechatronics Level 1 Fall of 2013 and Spring
of 2014.
1. Currently all course finals are not comprehensive, but cover from the mid-term
exam to the final exam. We will modify the course final to cover the entire course
curriculum. Therefore requiring the student to review the entire semester worth of
material. This will reinforce their memory over time. Completed and will continue
in future.
2. The 1100 & 1200 classes are taken over several semesters before the
comprehensive level 1 Exam. The Control group showed some details were lost over
time. Therefore a voluntary detail review of the 1100 Electronics & 1200 Mechanics
will be made available to the students before the comprehensive exam. Completed
and will continue in future.
3. A comprehensive math test score of 15 is now required for a student to enter into
the Mechatronics program. By increasing the math skills of the student before
entering the program should improve the overall average. Completed and will
continue in future.
Original plan Mechatronics Level 1 Fall of 2012 and Spring of 2013.
1. Currently all course finals are not comprehensive, but cover from the mid-term exam to
the final exam. We will modify the course final to cover the entire course curriculum.
Therefore requiring the student to review the entire semester worth of material. This
will reinforce their memory over time.
2. The 1100 & 1200 classes are taken over several semesters before the comprehensive
level 1 Exam. The Control group showed some details were lost over time. Therefore a
voluntary detail review of the 1100 Electronics & 1200 Mechanics will be made available
to the students before the comprehensive exam.
3. A comprehensive math test score of 15 is now required for a student to enter into the
Mechatronics program. By increasing the math skills of the student before entering the
program should improve the overall average.
List of supporting Documentation: Comprehensive Test Scores All Classes
Date of last update: 7-29-15