Department of Computing and
Technology
AAS in
Applied Technology
CIP Code: 159999
3 digit Program Code: 595
Program Quality Improvement Report 2009-2010
1
Action plan from 2008-2009 PQIR
Actions Taken
1. The single course in the list of requirements was
offered for two semesters … no enrollment …
2. Recruiting majors for the program
•
•
•
We aggressively pursued opportunities to attract new military majors … found
that there was significant competition on campus for military majors who might
be appropriately served by the AAS in AT.
Kept lines of communications open for progress with the co-op agreements with
GPTC.
Discovered new OSRHE policies that may have a negative impact on recruitment.
Went to a meeting on Career Tech Alliances, no resolution
2
Issues Surrounding the Program
1. The program was removed from abeyance to be able to take advantage of
BRAC and the increasing number of major possibilities
• BRAC has been delayed and the expected significant increase in
majors has not materialized.
2. In late 2007 and early 2008, Tom Russell and other faculty in the CaT
Department worked carefully with the Great Plains Technology Center
attempting to create a CO-OP program to allow majors to transfer to the
program with College Credit from programs at the Career Technology Center
(similar to that in Multi-media).
• These programs have been held up since that time because a change in
administration at WOSU has caused the need to renegotiate some
issues.
• We have been hesitant to move forward with further negotiations with
Great Plains because of the lack of feedback on the previous attempts
3. There has not been a large influx of majors as expected since the program
has been removed from abeyance.
Fall 2009
Program Quality Improvement Report 2008-2009
3
Further Issues
1. There are only a very small number of majors (15 listed, but only 6 or 7 likely
actual majors) … Students who have low ACT must choose an associates
degree to major in first. Then, they transfer to another major when they have
completed their developmental classes.
2. Averaging less than 2 graduates a year for the past 5 years.
3. We now require new majors to take one course in the “Core” of the program,
but there has not been enough students to offer the course. We have tried
to offer in individual study but no students have needed it so far.
4. The faculty did not want to present this PQIR because what can we say? …
a. There are very few majors or graduates (as yet)
b. We have not offered any core classes to support any assessment.
Fall 2009
Program Quality Improvement Report 2008-2009
4
Special Objectives of the Program
The stated objectives of the Associate in Applied Science in Applied Technology
can be observed by examining the Cameron University catalog description for
the A.A.S. in Applied Technology. This description follows:
The degree is structured to enable a student to incorporate credit for
technology skills acquired from military experience and courses at a
technology and career center or similar provider of technology training.
Students may be required to complete up to 12 semester hours of Cameron
University courses before credit for technology component can be placed on
the transcript. Active duty military personnel are exempt from that
requirement.
Fall 2009
Program Quality Improvement Report 2008-2009
5
Program Outcomes
1.
2.
3.
4.
Program Outcome 1: Students must understand and possess a high
ethical standard.
SLO 1. Students will demonstrate ethical behavior in a variety of
circumstances. (Blooms … understanding)
Program Outcome 2: Students must possess the ability to
communicate with a diverse user group, in a variety of settings to a
variety of audiences and purposes.
SLO 2. Students will be able to show critical thinking skills to
demonstrate professional quality work using a variety of oral, written
and multimedia techniques. (Blooms … understanding)
Program Outcome 3: Students will meet their individual education
goal of completing the degree for possible employment,
advancement, or transition to a bachelor degree program.
SLO 3. Students will complete the degree. (Blooms … application)
Program Outcome 4: Students will draw on their education to
support career growth.
SLO 4. Students will demonstrate how the degree supported their
career. (Blooms … application)
6
Alignment of Outcomes
General Alignment of Outcomes
The A.A.S. in AT program, as well as all programs in the CaT
Dept., support the University Mission in the Cameron University
Plan 2013 as stated below…
“Cameron University provides a diverse and dynamic student
body access to quality educational opportunities; foster a
student-centered academic environment that combines
innovative classroom teaching with experiential learning;
prepare students for professional success, responsible
citizenship, life-long learning, and meaningful contributions to a
rapidly changing world; and is a driven force in the cultural life
and economic development of the region.”
Program Quality Improvement Report 2009-2010
7
Alignment of Outcomes
• professional success
 Outcomes SLO 1, SLO 2, SLO 3, SLO 4
• meaningful contributions to a rapidly changing
world
 Outcome SLO 1, SLO 2
Program Quality Improvement Report 2009-2010
8
Measures of Learning and Service Outcomes
1.
Direct measurement … In TECH 2033, students will have multiple
projects over ethical standards. They will be scored with a rubric by
multiple faculty.
Program Objective 1: Students must understand and possess a high ethical
standard.
SLO 1. Students will demonstrate ethical behavior in a variety of circumstances.
(Blooms … understanding)
2.
Direct Measurement. Process oriented projects will be required that
will demonstrate students capabilities in oral and written
communications. Assessment will be done by numerous faculty
members.
Program Objective 2: Students must possess the ability to communicate with a
diverse user group, in a variety of settings to a variety of audiences and
purposes.
SLO 2. Students will be able to show critical thinking skills to demonstrate
professional quality work using a variety of oral, written and multimedia
techniques. (Blooms … understanding)
9
Measures of Learning and Service Outcomes
3.
Direct Measurement. Students will be asked to present a completed
portfolio reflecting overall completion of selected courses in their
plan of study.
Program Objective 3: Students will meet their individual education goal of
completing the degree for possible employment, advancement, or transition to a
bachelor degree program.
SLO 3. Students will complete the degree. (Blooms … application)
Strategy
Initial interview. Students selecting this program will have a one-on-one
interview with their advisor to agree on the individual degree plan and the
personal objectives of the student.
A degree completion interview will be held and the student will present their
portfolio.
4.
Indirect measurement. Students will be tracked for five years after
receiving the A.A.S. degree. Department will send out an annual
survey of graduates.
Program Objective 4: Students will draw on their education to support career
growth.
SLO 4. Students will demonstrate how the degree supported their career.
(Blooms … application)
10
Program goals and objectives
1.
Program Objective 1: Students must understand and possess a high
ethical standard.
SLO. Students will demonstrate ethical behavior in a variety of
circumstances. (Blooms … understanding)
Direct measurement … In TECH 2033, students will have multiple
projects over ethical standards. They will be scored with a rubric by
multiple faculty.
11
Program objective and measurement
PROGRAM GOAL: Program Outcome #1. Students must understand and possess a high ethical standard.
MEASUREMENT OF PROGRAM OBJECTIVE
PROGRAM
OBJECTIVE 1
Students will
demonstrate
ethical behavior
in a variety of
circumstances.
(Blooms …
understanding)
CURRICULUM
AREA OR TARGET
AUDIENCE
TECH 2033
Measurements
Direct - Projects
will be required
that will have the
students create an
ethics argument for
a specific audience
and purpose.
Methods used to
determine validity
of measurement
instruments
Methods used
to determine
reliability of
measurements
Criterion
referenced scores
Inter-rater
reliability
Schedule for
measurements
Each time TECH
2033 is offered
and makes.
Assessed via rubric
by CaT Dept
program
assessment
committee.
12
Display of assessment data
1. Display of data indicating
• Number of students participating in each
measurement
• Breakdown of the results
• Aggregate result of each assessment
measurement
The class TECH 2033 was cancelled because no
students enrolled. Thus … there was no
measurement and no data
Program Quality Improvement Report 2009-2010
13
Analysis of assessment data
1. Use a multi-year trend chart to demonstrate
effectiveness of the outcome over time,
preferably with 3 or more years of data
2. Compare data to Oklahoma, regional/peer
institution norms if available
3. Compare data to national norms if available
The class TECH 2033 was cancelled because no
students enrolled. Thus … there was no
measurement , no data, and no analysis
Program Quality Improvement Report 2009-2010
14
Action plan for Student-Learning or Service
Outcomes
1. The course TECH 2033 will be offered and possibly
there will be some enrollments so that
measurements can be made.
2. Timeline – TECH 2033 was offered in the Fall
2010 with no enrollment. TECH 2033 will be
offered again in Spring 2011.
3. Right now, if TECH 2033 is offered, it will be noload and will cost nothing in terms of resources.
Program Quality Improvement Report 2009-2010
15
Ancillary Actions
1. Program shareholders are in the process of
meeting to determine a different mechanism for
the assessment of this outcome.
2. Timeline – Ongoing. It is planned to implement
an alternate strategy as soon as possible, possibly
Spring 2011.
3. Resources required will be minimal.
Administrative and faculty time and effort for a
small number of students.
Program Quality Improvement Report 2009-2010
16
Program goals and objectives
2.
Program Objective 2: Students must possess the ability to
communicate with a diverse user group, in a variety of settings to a
variety of audiences and purposes.
SLO. Students will be able to show critical thinking skills to
demonstrate professional quality work using a variety of oral, written
and multimedia techniques. (Blooms … understanding)
Direct Measurement. Process oriented projects will be required that
will demonstrate students capabilities in oral and written
communications. Assessment will be done by numerous faculty
members.
17
Program objective and measurement
PROGRAM GOAL: Program Outcome #2. Students must possess the ability to communicate with a diverse user group,
in a variety of settings to a variety of audiences and purposes.
MEASUREMENT OF PROGRAM OBJECTIVE
PROGRAM
OBJECTIVE 1
Students will be
able to show
critical thinking
skills to
demonstrate
professional
quality work
using a variety of
oral, written and
multimedia
techniques.
CURRICULUM
AREA OR TARGET
AUDIENCE
TECH 2033
Measurements
Direct - Students
will be assigned
writing and
presentation
projects.
Methods used to
determine validity
of measurement
instruments
Methods used
to determine
reliability of
measurements
Criterion
referenced scores
Inter-rater
reliability
Schedule for
measurements
Each time TECH
2033 is offered
and makes.
Assessed via rubric
by CaT Dept
program
assessment
committee.
18
Display of assessment data
1. Display of data indicating
• Number of students participating in each
measurement
• Breakdown of the results
• Aggregate result of each assessment
measurement
The class TECH 2033 was cancelled because no
students enrolled. Thus … there was no
measurement and no data
Program Quality Improvement Report 2009-2010
19
Analysis of assessment data
1. Use a multi-year trend chart to demonstrate
effectiveness of the outcome over time,
preferably with 3 or more years of data
2. Compare data to Oklahoma, regional/peer
institution norms if available
3. Compare data to national norms if available
The class TECH 2033 was cancelled because no
students enrolled. Thus … there was no
measurement , no data, and no analysis
Program Quality Improvement Report 2009-2010
20
Action plan for Student-Learning or Service
Outcomes
1. The course TECH 2033 will be offered and possibly
there will be some enrollments so that
measurements can be made.
2. Timeline – TECH 2033 was offered in the Fall
2010 with no enrollment. TECH 2033 will be
offered again in Spring 2011.
3. Right now, if TECH 2033 is offered, it will be noload and will cost nothing in terms of resources.
Program Quality Improvement Report 2009-2010
21
Ancillary Actions
1. Program shareholders are in the process of
meeting to determine a different mechanism for
the assessment of this outcome.
2. Timeline – Ongoing. It is planned to implement
an alternate strategy as soon as possible, possibly
Spring 2011.
3. Resources required will be minimal.
Administrative and faculty time and effort for a
small number of students.
Program Quality Improvement Report 2009-2010
22
Program goals and objectives
3.
Program Objective 3: Students will meet their individual education
goal of completing the degree for possible employment,
advancement, or transition to a bachelor degree program.
SLO. Students will complete the degree. (Blooms … application)
Direct Measurement. Students will be asked to present a completed
portfolio reflecting overall completion of selected courses in their
plan of study.
Initial interview. Students selecting this program will have a one-on-one
interview with their advisor to agree on the individual degree plan and the
personal objectives of the student.
A degree completion interview will be held and the student will present their
portfolio.
23
Program objective and measurement
PROGRAM GOAL: Program Outcome #3: Students will meet their individual education goals of completing the degree for
possible employment, advancement, or transition to a bachelor degree program..
MEASUREMENT OF PROGRAM OBJECTIVE
PROGRAM
OBJECTIVE 1
Students will
complete the
degree
CURRICULUM
AREA OR TARGET
AUDIENCE
Measurements
Entering and
exiting majors
Indirect – entering
student survey
Indirect – exiting
student survey
Direct – exit
portfolio review
Assessed via rubric
by CaT Dept
program
assessment
committee.
Methods used to
determine validity
of measurement
instruments
Methods used
to determine
reliability of
measurements
Schedule for
measurements
Entering student
survey – survey
given by advisor
during first
advising session
Exiting student
survey – survey
given by advisor
during senior
level advising
session
Exit portfolio
examined during
last semester
24
Display of assessment data
Note that some students DO complete the degree!
Program Quality Improvement Report 2009-2010
25
Display of assessment data
New Student Those advised in Initial Interview
Count
CaT Dept
Count
Graduate
Count
Graduate Graduate Portfolios
Survey Count
Examined
Summer 2009
2^
0
0
1
0
0
Fall 2009
4^^
0
0
1
0
0
Spring 2010
8
0
0
1
0
0
Total
14
0
0
3
0
0
^ both new freshmen dropped out
^^ all new freshmen dropped out to return in Spring 2010
Program Quality Improvement Report 2009-2010
26
Analysis of assessment data
1. Students generally go to an advisor outside of the CaT Department for the
first two or three of their advising sessions. This is problematic when we are
trying to have students do an initial interview.
•
Many of the majors in the AAS in AT have selected this major as a
placeholder major until they can transfer into a bachelors program.
They are not really interested in an initial interview.
•
The major faculty shareholder for the AAS in AT program had been
Tom Russell – who is recently retired. There was a problem in the
turnover of this “shareholder-ship” to a follow-up faculty because of its
low-enrollment/low-visibility status.
2. None of the graduates so far have had to take any classes in CaT
Department offerings. This makes a portfolio very difficult to manage.
Faculty believe that if we make majoring in the AAS in AT too difficult,
students will choose its competitor which has no such requirement.
3. The exit interviews for our 3 graduates were forgotten. Tom Russell would
normally have taken care of this but alas, he is retired.
Program Quality Improvement Report 2009-2010
27
Ancillary Actions
1. Faculty suggestions…
•
•
Program shareholders are trying to refine our enrollment system so that
it is possible and even convenient to do the entry and exit interviews.
Faculty suggest that we rethink the portfolio issue and initially have
students create a class portfolio in TECH 2033 (when it becomes a
requirement that they take it).
2. Resources required will be minimal. Administrative and
faculty time and effort for a small number of students.
Program Quality Improvement Report 2009-2010
28
General Ancillary Actions
• Faculty have had serious discussions about whether
we should abey or delete the AAS in AT.
• Issues include
– Low enrollment and low graduation rates… this causes notice from the
regents and the filing of low productivity program reports.
– New procedures at OSRHE may negatively affect the program.
– We requested to set up a CO-OP program at GPTC several years ago
with no success and no real feedback as yet. Without such an
agreement, it is unlikely that the program will ever be viable.
Program Quality Improvement Report 2009-2010
29
Published information on graduates
Academic Year 08-09
Entered Bachelors Program
1
1
Summer 2009
Fall 2009
Unknown
1
Fall 2008
Spring 2009
Working In Discipline
1
1
Spring 2010
Summer 2010
2
Total
4
2
Program Quality Improvement Report 2009-2010
1
30
QUESTIONS?
Fall 2009
Program Quality Improvement Report 2008-2009
31