Computing & Technology
School of Science and Technology
A.A.S. in Information
Technology
CIP Code: 11-0103
Program Code: 514
Program Quality Improvement Report 2009-2010
1
Program actions since last assessment
presentation
1. Have meeting with stakeholders of the IT Program
in order to set target scores of different outcomes
for the 2009-2010.
1. To performs a pretest as well as continue with
posttest in IT2063.
2
Program actions since last assessment
presentation
3. Insert in assessment in outcome SLO2. …must
understand the impact that information
technology has on society as a whole and must
know the importance of continual learning in the
CIS 1013 Intro to Computer Information Systems.
4. Insert in assessment in outcome SLO4. …must be
able to choose from a variety of different problem
solving methodologies to analytically formulate a
solution using a high level programming language
in IT2413 Programming II.
3
Student-Learning or Service Outcomes
1. must understand the value of high ethical
standards (Bloom’s Knowledge);
2. must understand the impact that information
technology has on society as a whole and must
know the importance of continual learning
(Bloom’s Knowledge);
3. must possess the ability to communicate in a
variety of settings using oral, written, multimedia
techniques to a variety of audiences and must
interact with and understand diverse groups using
a strong IT vocabulary (Bloom’s Application);
Program Quality Improvement Report 2009-2010
4
Student-Learning or Service Outcomes
4. must be able to choose from a variety of different
problem solving methodologies to analytically
formulate a solution using a high level
programming language (Bloom’s Analysis);
5. must understand the planning, performing, and
evaluation process as it relates to information
technology operations and must understand
system phases, and the Systems Development Life
Cycle (SDLC) (Bloom’s Knowledge); and
Program Quality Improvement Report 2009-2010
5
Student-Learning or Service Outcomes
6. must understand basic computer networks
infrastructure and demonstrate proficiency in
assembling, configuring and administering
networks (Bloom’s Knowledge & Application).
Program Quality Improvement Report 2009-2010
6
Alignment of Outcomes
The AAS in IT program as well as all programs in the CaT
Department support the University Mission as found in the
Cameron University Plan 2013 and as stated below:
“Cameron University provides a diverse and dynamic student
body access to quality educational opportunities; foster a
student-centered academic environment that combines
innovative classroom teaching with experiential learning;
prepare students for professional success, responsible
citizenship, life-long learning, and meaningful contributions to
a rapidly changing world; and is a driven force in the cultural
life and economic development of the region.”
Program Quality Improvement Report 2009-2010
7
Alignment of Outcomes
• Outcomes 1, 2
 Responsible citizenship
• Outcomes 1, 2, 3, 4 , 5, 6
 professional success
• Outcome 2, 6
 Prepare students for life-long learning
Program Quality Improvement Report 2009-2010
8
Alignment of Outcomes
As well as the School of science & Technology mission of
• educate students in an intellectual atmosphere based on
academic excellence, high ethical standards, and exposure to
the latest advances in our academic disciplines;
• assist our students in developing the skills and confidence to
excel as life-long learners;
• prepare our graduates for success in a diverse and dynamic
environment;
• create an atmosphere conducive to professional growth for
faculty and staff;
• support community efforts relevant to Cameron University.
Program Quality Improvement Report 2009-2010
9
Alignment of Outcomes
And the Computing and Technology Department Mission of
• providing quality academic programs based on academic excellence, high
ethical standards, and learning outcomes for each of the computing and
technology disciplines;
• assist students in developing the skills and confidence to excel as life-long
learners;
• prepare computing and technology graduates at both the A.A.S. and B.S.
levels for success in a diverse and dynamic environment;
• provide faculty and staff with an atmosphere conducive to professional
growth through an annual individualized appraisal program;
• support community efforts involving computing and technology disciplines
relevant to the university, school, and department.
Program Quality Improvement Report 2009-2010
10
Measures of Learning and Service Outcomes
Direct measures of student-learning or service
outcomes:
•
•
Locally developed tests
The Blackboard tool blogging was used to receive
feedback from students
Program Quality Improvement Report 2009-2010
11
Measures of Learning and Service Outcomes
Strategies & Methodologies that address shortfalls in
student learning or services prior to graduation
•
Computer resources for doing more hands-on:
–
–
Myitlab
Mac computers for networking and installation of
operating systems
Program Quality Improvement Report 2010-2011
12
Measures of Learning and Service Outcomes
Strategies & Methodologies that address shortfalls in
student learning or services prior to graduation
•
Partnership with the Cyber Security Education
Consortium (CSEC):
⁻
⁻
Faculty training - three faculty have attended 3
workshops and two have attended 1 workshop,
Alignment of IAS courses to core areas of CSEC.
Program Quality Improvement Report 2010-2011
13
Measures of Learning and Service Outcomes
Strategies & Methodologies that address shortfalls in
student learning or services prior to graduation
•
Offering of more options in schedule an teaching
delivery:
⁻
⁻
Course delivering time change (ex. night classes),
IAS 2233 is under development as an online course.
Program Quality Improvement Report 2010-2011
14
Report on actions from the three previously
chosen priority outcomes
We perform an action plan that includes all six
outcomes:

First outcome changed
•
to
•
must understand and demonstrate application of a
high ethical standard
must understand the value of high ethical standard
Program Quality Improvement Report 2009-2010
15
Report on actions from the three previously
chosen priority outcomes

Develop of the master syllabi for IT courses mapping
outcomes to specific course outcomes. Found at
•

W:\Workgrps\Computing\Syllabi\_Master
Syllabi\IT_MasterSyllabi
Posted in the web page including study plan. Found at
http://www.cameron.edu/comptech/syllabi/syllabi.html
And
http://www.cameron.edu/comptech/typical/typical.html
Program Quality Improvement Report 2009-2010
16
Report on actions from the three previously
chosen priority outcomes

Compare our program with other Universities.
•
We are now part of the Cyber Security Education Consortium
and we are aligning our courses to the core of CSEC
Program Quality Improvement Report 2009-2010
17
Student-learning or service outcome and measurements
MEASUREMENTS OF STUDENT LEARNING OR SERVICE OUTCOME
PROGRAM
OUTCOME # 1
must understand
the value of a
high ethical
standard
CURRICULUM
AREA OR TARGET
AUDIENCE
CIS 1013 –
EET1063 IAS2233
Measurements
Methods used to
determine validity
of measurement
instruments
Methods used
to determine
reliability of
measurements
Schedule for
measurements
Locally developed
test (direct)
No method used
until now
No method
used until now
Annually , Fall
Semester
Program Quality Improvement Report 2009-2010
18
Display of Assessment Data –
must understand the value of high ethical standards
Score
0
1
2
3
4
5
6
7
8
9
10
11
12
13
# Students
0
0
0
0
0
0
0
0
0
1
1
0
1
11
Overall rating: 12.43 over a scale of 13. Standard dev. Of 1.28
On the final a total of 14 students were given three scenarios that
may occur a in school or work environment that pose ethical dilemmas.
The responses were measured on a scale of zero and one.
One (1), being able to provide the response with a valid explanation of the
Response, and zero (0) for failing to provide a valid response or explanation.
Program Quality Improvement Report 2009-2010
19
Analysis of Assessment Data must understand the value of high ethical standards
This is the first time that we took assessment of this
outcome, for this reason we did not
1. Use a multi-year trend chart to demonstrate
effectiveness of the outcome over time,
preferably with 3 or more years of data
2. Compare data to Oklahoma, regional/peer
institution norms if available
3. Compare data to national norms if available
Program Quality Improvement Report 2009-2010
20
Action Plan for Student- Learning
must understand the value of high ethical standards
1. To continue emphasis in the importance and
knowledge of the value of ethics in our society.
2. To review if this outcome is measured in the
Information Systems (IS) standard exam; if not, to
continue with in house test.
Program Quality Improvement Report 2009-2010
21
Student-learning or service outcome and measurements
MEASUREMENTS OF STUDENT LEARNING OR SERVICE OUTCOME
PROGRAM
OUTCOME # 2
must understand
the impact that
information
technology has
on society as a
whole and must
know the
importance of
continual
learning;
CURRICULUM
AREA OR TARGET
AUDIENCE
CIS 1013
Measurements
Post in Blackboard
a Blog about the
mission of the
University
Methods used to
determine validity
of measurement
instruments
Methods used
to determine
reliability of
measurements
Schedule for
measurements
No method used
until now
No method
used until now
Annually , Spring
Semester
Program Quality Improvement Report 2009-2010
22
Display of Assessment Data –
must know the importance of continual learning
Score
1
2
3
No. of Scores
4
8
18
Overall rating: 2.5 over a scale of 3
A total of 30 students participated in a blog posted on Blackboard about
The third bullet of our University mission: ” Prepare students for professional
Success, responsible citizenship, life-long learning, and a meaningful
Contributions to a rapidly changing world.”
A rubric of 1, 2, 3 was used, being 3 the highest score.
Program Quality Improvement Report
2010-2011
23
Display of Assessment Data –
must know the importance of continual learning
Example of students comments from blog:
• “This is my second semester at CU. I have taken classes from other
colleges and universities. So far the degree plans incorporates the goals of
the mission statement. Classes such as speech, this computer class and so
forth that are required give us the tools to further our education.”
• “How fortunate we are in southwest Oklahoma to have Cameron
University so conveniently located and so capably meeting our changing
educational needs. Whether we're upgrading skills for an existing job
or re-training for a new career, whether we're fresh from high school or
long-retired exploring new interests, Cameron certainly does prepare us
for professional success, encourage responsible citizenship and, through
life-long learning, allow us to continue to make meaningful contributions
to our world.”
Program Quality Improvement Report
2010-2011
24
Analysis of Assessment Data must know the importance of continual learning
This is the first time that we took assessment of this
outcome, for this reason we did not
1. Use a multi-year trend chart to demonstrate
effectiveness of the outcome over time,
preferably with 3 or more years of data
2. Compare data to Oklahoma, regional/peer
institution norms if available
3. Compare data to national norms if available
Program Quality Improvement Report 2009-2010
25
Action Plan for Student- Learning
must know the importance of continual learning
1. Review of course content to match certifications
(May 2011)
2. Resources needed: One Faculty with lower load
Program Quality Improvement Report 2009-2010
26
Student-learning or service outcome and measurements
MEASUREMENTS OF STUDENT LEARNING OR SERVICE OUTCOME
PROGRAM
OUTCOME # 6
must understand
basic computer
networks
infrastructure
and demonstrate
proficiency in
assembling,
configuring and
administering
networks.
CURRICULUM
AREA OR TARGET
AUDIENCE
Measurements
Methods used to
determine validity
of measurement
instruments
EET 1063 – IT
2063
Embedded
questions in exams
No method used
until now
Program Quality Improvement Report 2009-2010
Methods used
to determine
reliability of
measurements
Schedule for
measurements
No method
used until now
Annually , Spring
Semester
27
Display of Assessment Data –
proficiency in assembling, configuring and
administering networks
• A total of 14 students were given a pre-test on the first day of
class. The main focus of the test was to determine students’
previous exposure to installation, configuration and
administration of operating systems in a network.
• Each Pre-test was scored on a scale of zero (0) to fourteen
(14), with zero indicating no exposure and fourteen indicating
mastery:
Pretest
Score
0
1
2
3
4
5
6
7
8
9
10 11 12 13 14
# Students 1
2
1
2
2
0
0
1
1
2
1
0
0
1
0
Mean: 5.29, standard dev 4.0
Program Quality Improvement Report
2010-2011
28
Display of Assessment Data –
proficiency in assembling, configuring and
administering networks
• A Post-test was given to 14 students along with the final exam
on May 4, 2010. The Post-test was the same as the Pre-test.
The objective of the Post-test was to determine the student
learning after completing the course:
Post test
Score
0
1
2
3
4
5
6
7
8
9
10 11 12 13 14
# Students 0
0
0
0
0
0
0
0
0
4
1
1
5
0
3
Mean: 11.36, standard dev 1.9
Program Quality Improvement Report
2010-2011
29
Display of Assessment Data –
proficiency in assembling, configuring and
administering networks
Comparison of scores of Pre-test & Post-test:
Mean
Variance
Observations
P(T<=t) one-tail
Variable 1
5.285714286
16.06593407
14
8.27215 * E-06
Variable 2
11.35714286
3.631868132
14
Conclusion: the two distributions are statistically significant, i.e.,
different.
Program Quality Improvement Report
2010-2011
30
Display of Assessment Data –
proficiency in assembling, configuring and
administering networks
Comparing with previous year
Year
Average
Std. dev.
# Participants
2008
81.82
8.74
11
2009
95.90
9.58
14
Overall rating over a scale of 100
Comparing 2008 with 2009 we see on average an increase in the
Learning process for this outcome.
Program Quality Improvement Report
2010-2011
31
Action Plan for Student- Learning
proficiency in assembling, configuring and
administering networks
1. Install Mac computers in the Lab
2. Review of text books and course content to match
certifications
3. Resources needed: One Faculty with lower load
Program Quality Improvement Report 2009-2010
32
Action Plan IT – 3 years
• To get accreditation as a Center of Academic
excellence (year 2013)
• To continue review of Outcomes
• Resources needed: One Faculty with lower
load
Program Quality Improvement Report
2010-2011
33
Published information on graduates
Academic Year 09-10
Entered Graduate School
Working In Discipline
Other
Summer 2009
Fall 2009
1
Spring 2010
Total
Program Quality Improvement Report 2009-2010
34