Dept. of Computing and Technology (CaT)
School of Science and Technology
B.S. in Computer Science (CS)
CIP Code: 110101
Program Code: 415
Program Quality Improvement Report 2009-2010
1
Program actions since last assessment
presentation
(actions from previous 3 priority outcomes*)
1. Discussed implementing an entry level
assessment under the new curriculum.
2. Discussed the position of the midlevel
assessment under the new curriculum.
3. Continued including team-work projects in lower
division courses CS1313, CS1513, and CS2413.
2
Program actions since last assessment
presentation
(actions from previous 3 priority outcomes*)
4. Planed to offer the new CS curriculum starting
with fall 2010.
5. Began discussions of revising the current
assessment tools to be inline with the new
curriculum.
3
Student Learning or Service Outcomes
General Student Learning Outcomes
A-1. Students will possess the necessary knowledge and skills
to solve problems using a computer (Bloom’s
Knowledge).
A-2. Students will understand and classify algorithms,
structures, and
computational systems. (Bloom’s Understanding).
A-3. Students will be able to apply what they have learned to
perform successfully at entry-level positions in industry,
or gain admission to graduate/professional schools
(Bloom’s Application).
Program Quality Improvement Report 2009-2010
4
Student Learning or Service Outcomes
Specific Student Learning Outcomes
B-1. Be able to design and create computer programs
(Bloom’s Synthesis).
B-2. Demonstrate the ability to evaluate data structures,
discrete structures, and algorithms (Bloom’s Evaluation).
B-3. Be able to analyze computer architectures, operating
systems, and networking (Bloom’s Analysis).
B-4. Demonstrate sufficient professional communication skills.
Program Quality Improvement Report 2009-2010
5
Alignment of Outcomes
The B.S. in CS program, as well as all programs in the CaT Dept.,
support the University Mission in the Cameron University Plan
2013 as stated below…
“Cameron University provides a diverse and dynamic student
body access to quality educational opportunities; foster a
student-centered academic environment that combines
innovative classroom teaching with experiential learning;
prepare students for professional success, responsible
citizenship, life-long learning, and meaningful contributions to a
rapidly changing world; and is a driven force in the cultural life
and economic development of the region.”
Program Quality Improvement Report 2009-2010
6
Alignment of Outcomes
• Outcomes A-1, B-1
 experiential learning
• Outcomes A-2, A-3, B-1, B-2, B-3, B-4
 professional success
• Outcome B-1, B-2, B-3, B-4
 meaningful contributions to a
rapidly changing world
Program Quality Improvement Report 2009-2010
7
Student Learning Outcome Measurements
List of Direct Measures of Student Learning Outcomes
B-1 Programming Project
B-2 CS Skills Examination
B-3 National Major Field Assessment Test (MFAT)
8
Student Learning Outcome Measurements
List of Indirect Measures of Student Learning Outcomes
•
Exit Surveys
9
Student Learning Outcome Measurements
PROGRAM GOAL: A-1 Students will possess the necessary knowledge and skill to solve problems using a computer.
MEASUREMENT OF PROGRAM OBJECTIVE
PROGRAM
OBJECTIVE 1
B-1 Programming
Fundamentals .
Demonstrate the
ability to design
and create a wellorganized
computer
program.
CURRICULUM
AREA OR TARGET
AUDIENCE
CS 4203 Software
Engineering
Measurements
Locally developed
programming
project (direct)
Methods used to
determine validity
of measurement
instruments
Methods used
to determine
reliability of
measurements
Norm-referenced
scores
Inter-rater
reliability
Schedule for
measurements
Annually , at the
beginning of the
Spring Semester
10
Student Learning Outcome Measurements
PROGRAM GOAL: A-2 Students will understand and classify algorithms, structures, and computational systems.
MEASUREMENT OF PROGRAM OBJECTIVE
PROGRAM
OBJECTIVE 2
B-2 Be able to
evaluate data
structures and
algorithms.
CURRICULUM
AREA OR TARGET
AUDIENCE
Measurements
Methods used to
determine validity
of measurement
instruments
CS 4203 Software
Engineering
Locally developed
test (direct)
Norm-referenced
scores
Methods used
to determine
reliability of
measurements
Inter-rater
reliability
Schedule for
measurements
Annually , at the
beginning of the
Spring Semester
11
Student Learning Outcome Measurements
PROGRAM GOAL: A-2 Students will understand and classify algorithms, structures, and computational systems.
MEASUREMENT OF PROGRAM OBJECTIVE
PROGRAM
OBJECTIVE 3
B-3 Be able to
evaluate different
architectures,
operating
systems, and
networking
protocols.
CURRICULUM
AREA OR TARGET
AUDIENCE
CS 4203 Software
Engineering
Measurements
National MFAT
Exam (Major Field
Assessment Test)
Methods used to
determine validity
of measurement
instruments
Methods used
to determine
reliability of
measurements
Schedule for
measurements
Norm-referenced
scores
Inter-rater
reliability
Annually , Spring
Semester
12
Display and Analysis of Assessment Data
Spring
2000
F
10
1
2
1
1
1
S
100
96
94
92
90
80
Mean
96.6
Std dev.
5.4
N
16
Spring
2001
F
S
3 95
2 90
1 85
1 80
1 75
1 70
1 65
1 40
1
0
Mean
73.3
Std dev.
29
N
12
TABLE 1
Results of the Problem Solving Skills (Programming Project)
Outcomes A-1, B-1
Spring Spring
Spring
Spring
Spring
Spring
2002
2003
2004
2005
2006
2007
F
1
2
2
3
1
1
1
S
100
90
85
80
75
70
0
Mean
75.9
Std dev.
26.4
N
11
F
6
2
1
2
1
1
1
S
100
95
90
80
70
50
40
Mean
85.7
Std dev.
19.8
N
14
F
4
4
1
S
100
92
80
Mean
94.2
Std dev.
6.6
N
9
F
3
2
1
3
1
2
1
S
100
95
80
70
65
60
0
Mean
74.2
Std dev.
27.3
N
13
F
5
1
1
1
1
S
100
90
88
85
0
Mean
84.8
Std dev.
32.4
N
9
F
2
1
1
1
3
S
100
95
90
80
70
Mean
84.4
Std. dev.
13.5
N
8
Program Quality Improvement Report 2009-2010
Spring
2008
Spring
2009
F
3
1
1
1
1
F
4
2
1
1
2
S
100
85
75
72
43
Mean
82.1
Std dev.
21
N
7
S
100
95
85
80
0
Mean
75.5
Std dev.
40.4
N
10
13
Display and Analysis of Assessment Data
TABLE 1 - Problem Solving Skills (Programming Project) …
Spring 2010
F
Score
2
100
2
95
1
90
1
80
4
50
Mean
Std Dev
N
76.0
23.1
10
Programming Project
Mean Score Trends
120
100
80
60
40
20
0
00
01
02
03
04
05
06
Program Quality Improvement Report
2009-2010
07
08
09
10
14
Display and Analysis of Assessment Data
Spring
2000
F
S
1
96
1
95
1
88
2
85
1
80
1
78
2
77
2
75
1
74
1
70
1
67
1
62
1
55
Mean
77.4
Std dev
11.0
N
16
Spring
2001
F
S
1
95
1
90
1
85
1
80
1
79
1
75
2
73
1
68
1
67
1
58
1
0
Spring
2002
F
S
1
93
1
89
1
84
1
82
1
80
1
78
3
70
1
61
1
53
TABLE 2
Results of the CS Skills Assessment
Outcomes A-2, B-2, B-3
Spring
Spring
Spring
Spring
2003
2004
2005
2006
F
S
F
S
F
S
F
S
1
95
1
95
2
96
1
96
1
91
2
87
1
92
1
93
2
88
1
84
1
90
1
90
1
87
2
81
1
88
2
87
2
82
1
80
1
86
1
79
1
78
2
77
1
76
1
76
1
77
1
64
1
74
1
73
1
75
1
67
1
41
1
68
1
64
1
43
1
57
1
40
1
38
1
24
1
35
Mean
70.3
Std dev
24.4
N
12
Mean
75.5
Std dev
11.9
N
11
Mean
72.7
Std dev
21.6
N
14
Mean
81.3
Std dev
8.1
N
10
Mean
73.7
Std dev
20.7
N
13
Mean
80.2
Std dev
16.6
N
9
Spring
2007
F
S
1
94
1
93
1
88
1
83
2
70
1
66
1
64
Spring
2008
F
S
1
97
1
84
2
78
1
77
1
69
1
43
Mean
78.5
Std dev
12.4
N
8
Mean
75.1
Std dev
16.6
N
7
Spring
2009
F
S
1
95
1
94
2
91
1
90
1
85
1
82
1
72
1
67
1
66
Mean
83.3
Std dev
11.1
N
10
15
Display and Analysis of Assessment Data
TABLE 2 – CS Skills Exam Assessment …
Spring 2010
F
Score
1
98
1
96
1
92
1
81
1
77
1
68
1
50
1
44
1
29
Mean
70.1
Std Dev
24.7
N
9
CS Skills Mean Score Trends
85
80
75
70
65
60
00
01
02
03
04
05
06
07
Program Quality Improvement Report
2009-2010
08
09
10
16
Display and Analysis of Assessment Data
TABLE 3
Results of the Major Field Achievement Test (MFAT)
Outcomes A2, B2, B3
Spring 2007
76 Institutions
Programming
Fundamentals
Discrete Structures,
Algorithms
Systems (Architecture,
Operating Systems,
Networking, Database)
Spring
2008
Spring
2009
Spring
2010
National Statistics
2006-2009
193 Institutions
Std.
Mean
Dev.
National
Mean
Dept.
Mean
Dept.
Mean
Dept.
Mean
Dept.
Mean
57.3
51
71
52
52
55.8
12.6
35.0
30
35
28
35
35.2
8.4
44.2
38
40
36
42
42.8
9.3
142
153
142
146
148.6
9.7
Overall Scores
*Score range for overall means 120-200
17
Display and Analysis of Assessment Data
Discrete Structures,
Algorithms
Programming Fundamentals
80
70
60
50
40
30
20
10
0
40
30
20
10
0
2007
2008
2009
2007
2010
Systems (Arch, Net, OS, DB)
44
2008
2009
2010
Overall Scores
155
42
150
40
145
38
36
140
34
135
32
2007
2008
2009
2010
2007
2008
Program Quality Improvement Report
2009-2010
2009
2010
18
Display and Analysis of Assessment Data
TABLE 4
Results of the Exit Survey – Spring 2008
Number Surveyed: 10
Strongly
Question
Agree
1. The computer science curriculum has given me a firm grounding in mathematics
and the sciences.
67%
Agree
Neutral
Disagree
Strongly
Disagree
33%
2. As a result of my education I feel confident of my abilities to utilize computer
science principles to identify, formulate, and solve computer science problems.
33%
67%
3. I am proficient in the application of these principles in the design of computer
software.
17%
83%
4. I feel I have gained the ability to communicate effectively, both orally and in
writing, with technical and non-technical audiences.
50%
50%
5. The CS program has helped me to work effectively, independently, and on teams
within the discipline and across disciplines.
67%
33%
Program Quality Improvement Report
2009-2010
19
Display and Analysis of Assessment Data
TABLE 4
Results of the Exit Survey – Spring 2009
Number Surveyed: 3
Strongly
Agree
Question
Agree
1. The computer science curriculum has given me a firm grounding in
33%
67%
mathematics and the sciences.
2. As a result of my education I feel confident of my abilities to
utilize computer science principles to identify, formulate, and
solve computer science problems.
67%
33%
3. I am proficient in the application of these principles in the design
of computer software.
33%
67%
4. I feel I have gained the ability to communicate effectively, both
orally and in writing, with technical and non-technical audiences.
67%
33%
5. The CS program has helped me to work effectively, independently,
And on teams within the discipline and across disciplines.
67%
33%
Neutral
Disagree
Strongly
Disagree
20
Display and Analysis of Assessment Data
TABLE 4 Continued
Results of the Exit Survey – Spring 2010
Number Surveyed: 7
Strongly
Question
Agree
1. The computer science curriculum has given me a firm grounding in mathematics
and the sciences.
71%
Agree
Disagree
Strongly
Disagree
29%
2. As a result of my education I feel confident of my abilities to utilize computer
science principles to identify, formulate, and solve computer science problems.
86%
14%
3. I am proficient in the application of these principles in the design of computer
software.
14%
86%
4. I feel I have gained the ability to communicate effectively, both orally and in
writing, with technical and non-technical audiences.
14%
72%
5. The CS program has helped me to work effectively, independently, and on teams
within the discipline and across disciplines.
43%
57%
Program Quality Improvement Report
2009-2010
Neutral
14%
21
Action plan for Student-Learning or Service
Outcomes
•
Update the student learning outcome
measurements to be inline with the new CS
curriculum
•
Update the requirements for the CS minor to be
inline with the new CS curriculum
Program Quality Improvement Report 2009-2010
22