Multimedia Design Department
School of Science & Technology
AAS in Multimedia Design
CIP Code -- 13.0501
Program Quality Improvement Report 2009-2010
1
*Student-Learning or Service Outcomes
1. Identify personal ethical foundations for decision making– Comprehension and Application
2. Conduct a needs analysis, task and target audience analysis, and sequence multimedia
content to meet the needs of the target audience – Comprehension, and Application
3. Demonstrate aptitude in at least one web development language or program. –
Comprehension and Application
4. Capture and edit digitized graphics, audio and video and import them into a multimedia
application. – Comprehension and Application
5. Demonstrate competence with at least two authoring tools – Comprehension and
Application
* Need to add “Communicate effectively in visual, oral and written form” in Spring 2011
* Bloom’s taxonomy for Academic programs
Program Quality Improvement Report 2009-2010
2.1
Student-Learning or Service Outcomes
•
Indicate objectives that are required by accrediting agencies
o No requirements for accreditation
o Program Objectives were derived from Instructional Design
Competencies; The Standards, 2nd Edition, ibstpi, Batavia, Il, 1994
(Revised for Academic use)
o Ibstpi =International Board of Standards for Training and Instruction
Program Quality Improvement Report 2009-2010
2.2
Alignment of Outcomes
1. University Mission– Offer high quality, challenging academic programs that include a global
perspective and respond to student and employer needs
2. School Mission – Enhance student opportunities for service learning, to include internships,
civic involvement and off-campus educational activities.
3. Program Mission – Develop a reputation for offering career-oriented programs that are
distinctive from other universities. These programs will produce graduates who are sought
after by business, industry and education, as well as graduates who are lifelong learners.
4. Strategic Plan 2013 – Improve Cameron University’s visibility and image locally, regionally and
nationally.
5. Capitalize on Cameron’s multiple levels of academic programs – associate, baccalaureate, and
master’s – to enhance student learning and to increase opportunities for educational
advancement.
Program Quality Improvement Report 2009-2010
3
Measures of Learning and Service Outcomes
1. Direct measures of student-learning or service outcomes
•
•
Portfolio Review
Capstone Course
2. Indirect measures of student-learning or service outcomes
•
•
Capstone Course
Ave. of 4 requests for gradates or interns per semester
3. Strategies / methodologies that address shortfalls in student learning or
service prior to graduation
•
•
•
•
Students present e-Portfolio to faculty for critique (Oral Presentations)
Recommend READINGS about e-Portfolio construction
Individually mentor or instruct before graduation
Faculty mentors compare AAS & BS portfolio artifacts with students
Program Quality Improvement Report 2009-2010
4
Report on Actions from the Three Previously
Chosen Priority Outcomes
(The outcomes and the actions & Evidence)
•
Provide more structure for students during the development of their
portfolios or services
A. Implementing spring-only Capstone courses beginning in SY 2010-2011 --– See
Fall 2010 / Spring 2011 Schedule
B. Implementing oral evaluation of all Capstone I students in Spring 2010 -Faculty observed presentations of the Capstone class once in Spring 2010.
C. Making portfolio quality at least half the Capstone I grade -- Implementing–
Capstone I Syllabus complete, pending department certification.
E. Emphasizing the use of artifacts that are desired by potential employers -Implementing
Program Quality Improvement Report 2009-2010
5.1
Report on Actions from the Three Previously
Chosen Priority Outcomes
(The outcomes and the actions & Evidence)
•
Integrating “Writing for Media” course when developed by Communication
Department —See below
•
Requesting ENGL 2333 in interim while waiting for Communication Dept.-Requested through Curriculum Committee.
•
Advising students to take an advanced course on writing for media -Implemented
•
Developing end of program test for the BS program. --
Under
Development/validation in spring ‘11
Program Quality Improvement Report 2009-2010
5.2
Report on Actions from the Three Previously
Chosen Priority Outcomes ---continued
(Multi-year data that indicates improved student learning is occurring)
Semester
AY 2008-09
AY 2009-10
Scale:
Portfolios
Totals
Objectives
Excellent
Above
Average
Average
1
(Ethical Issues)
xx
5
(Authoring Prog.)
x
Below
Average
Poor
2.10
2.83
17
14
4.6 to 5 = Excellent
3.6 to 4.5 = Above Average
2.6 to 3.5 = Average
Program Quality Improvement Report 2009-2010
Average*
x
3.20
2.28
1.6 to 2.5 = Below Average
5.3
Report on Actions from the Three Previously
Chosen Priority Outcomes ---continued
(Multi-year data that indicates improved student learning is occurring)
AY
Scale:
Objective No.
Objective No.
Score
08-09 (17)
1
2.10
5
3.20
09-10 (14)
1
2.83
5
2.28
4.6 to 5 = Excellent
2008-9 – Blue
2009-0 – Burnt Orange
Score
3.6 to 4.5 = Above Average
Objective 1= 2.10
Objective 1= 2.83
2.6 to 3.5 = Average
1.6 to 2.5 = Below Average
Objective 5 = 3.20
Objective 5 = 2.28
Program Quality Improvement Report 2009-2010
5.3
Student-learning or service outcomes and
measurements
MEASUREMENT OF PROGRAM OBJECTIVE
PROGRAM
OBJECTIVE 2
Conduct a
needs analysis,
task and target
audience
analysis, and
sequence
multimedia
content to
meet the
needs of the
target
audience.
*CURRICULUM
AREA OR TARGET
AUDIENCE
AAS in
Multimedia
Design
All the courses
except
MM1013
Reinforced in
most courses
in the
curriculum
Measurements
Direct: Portfolio
Methods used to
determine validity
of measurement
instruments
Methods used
to determine
reliability of
measurements
E-portfolio
Validity:
Criteria
established and
placed in
rubrics.
E-portfolio
Reliability: Eportfolios
measured by
four content
experts
independent
ly.
E-portfolios
measured
based on PO
criteria.
Schedule for
measurements
After each
semester in
which a
Capstone class
is held
Good interrater
reliability.
* Curriculum area matrices to undergo re-alignment in CY 2011.
Program Quality Improvement Report 2009-2010
7.1
Student-learning or service outcomes and
measurements
MEASUREMENT OF PROGRAM OBJECTIVE
PROGRAM
OBJECTIVE 3
Demonstrate
aptitude in at
least one web
development
language or
program.
*CURRICULUM
AREA OR TARGET
AUDIENCE
AAS in
Multimedia
Design
All the courses
Except
MM1143
Reinforced in
most courses
in the
curriculum
Measurements
Direct: Portfolio
Methods used to
determine validity
of measurement
instruments
Methods used
to determine
reliability of
measurements
E-portfolio
Validity:
Criteria
established and
placed in
rubrics.
E-portfolio
Reliability: Eportfolios
measured by
four content
experts
independent
ly.
E-portfolios
measured
based on PO
criteria.
Schedule for
measurements
After each
semester in
which a
Capstone class
is held
Good interrater
reliability.
* Curriculum area matrices to undergo re-alignment in CY 2011.
Program Quality Improvement Report 2009-2010
7.2
Student-learning or service outcomes and
measurements
MEASUREMENT OF PROGRAM OBJECTIVE
PROGRAM
OBJECTIVE 4
Capture and
edit digitized
graphics, audio
and video and
import them
into a
multimedia
application.
*CURRICULUM
AREA OR TARGET
AUDIENCE
AAS in
Multimedia
Design
All the courses
except
MM1143
MM 2132
Reinforced in
most courses
in the
curriculum
Measurements
Direct: Portfolio
Methods used to
determine validity
of measurement
instruments
Methods used
to determine
reliability of
measurements
E-portfolio
Validity:
Criteria
established and
placed in
rubrics.
E-portfolio
Reliability: Eportfolios
measured by
four content
experts
independent
ly.
E-portfolios
measured
based on PO
criteria.
Schedule for
measurements
After each
semester in
which a
Capstone class
is held
Good interrater
reliability.
* Curriculum area matrices to undergo re-alignment in CY 2011.
Program Quality Improvement Report 2009-2010
7.3
Display of Assessment Data
Semester
AY 2009-2010
Scale:
4.6 to 5 = Excellent
Portfolios
Totals
17
Objectives
Above
Excellent Average Average
Below
Average
Poor
Average*
2
x
2.87
3
x
2.90
4
x
3.6 to 4.5 = Above Average
2.6 to 3.5 = Average
2.87
1.6 to 2.5 = Below Average
Program Quality Improvement Report 2009-2010
8.1
Analysis of assessment data
1.
Use a multi-year trend chart to demonstrate level of effectiveness of
the objective over time
AY
Objective No.
Score
Objective No.
Score
Objective
No.
Score
06-07
2
2.80
3
2.94
4
NA
07-08
2
NA
3
NA
4
NA
09-10
2
2.88
3
2.90
4
2.87
2.
Compare data to Oklahoma and regional institution norms if
available--*No AAS programs exist with this CIP code
3.
Compare data to national norms if available--None available
* Researched during 5-Year Program Review, October 2009
Program Quality Improvement Report 2009-2010
9
Action plan for Student-Learning or Service
Outcomes
Provide more structure for students during the
A. Implementing Spring only Capstone courses beginning in SY 2010-2011.
B. Implementing oral evaluation of all Capstone II students in Spring 2011.
C. Making portfolio quality (good artifacts, good reflections and good
functionality) at least half the Capstone grade
D. Emphasizing the use of artifacts that are desired by potential employers.
E. Requiring use of projects created during AAS studies for portfolio.
Program Quality Improvement Report 2009-2010
10.1
Action plan for Student-Learning or Service
Continue…
•
Monitor curriculum changes to require a course on writing for media.
( ENGL 2333 in interim.)
•
Continue development/validation of an end of program test for the BS
program.
Program Quality Improvement Report 2009-2010
10.2
Published information on graduates
Academic Year 08-09
Summer 2009
Pursuing BS in
Multimedia
Pursuing BS in
other Discipline
Entered Graduate
School
Working In
Discipline
Unknown
1
Fall 2009
1
Spring 2010
4
Total = 6
5
1
Program Quality Improvement Report 2009-2010
12