Multimedia Design Department
School of Science & Technology
BS in Multimedia Design
CIP Code -- 13.0501
Program Quality Improvement Report 2009-2010
1
Student-Learning or Service Outcomes
1. Communicate effectively in visual, oral and written form– Synthesis and Application
2. Identify and resolve ethical and legal implications of design in the work place– Comprehension
and Application
3. Conduct a needs assessment– Synthesis
4. Identify and describe target audience – Synthesis
5. Analyze the characteristics of one or two existing and emerging technologies and their use in an
instructional, marketing, or entertainment environment– Analysis
6. Select and use a variety of techniques and strategies to define and sequence multimedia content
– Analysis and Evaluation
7. Capture and edit digitized graphics, animation, audio and video and import them into computerbased and/or web-based applications– Analysis and Synthesis
8. Demonstrate familiarity with at least one basic and one advanced authoring program or basic and
one advanced web authoring tool.– Analysis
* Bloom’s taxonomy for Academic programs
Program Quality Improvement Report 2009-2010
2.1
Student-Learning or Service Outcomes
•
Indicate objectives that are required by accrediting agencies
o No requirements for accreditation
o Program Objectives were derived from Instructional Design
Competencies; The Standards, 2nd Edition, ibstpi, Batavia, Il, 1994
(Revised for Academic use)
o Ibstpi =International Board of Standards for Training and Instruction
Program Quality Improvement Report 2009-2010
2.3
Alignment of Outcomes
1. University Mission– Offer high quality, challenging academic programs that include a global
perspective and respond to student and employer needs
2. School Mission – Enhance student opportunities for service learning, to include internships,
civic involvement and off-campus educational activities.
3. Program Mission – Develop a reputation for offering career-oriented programs that are
distinctive from other universities. These programs will produce graduates who are sought
after by business, industry and education, as well as graduates who are lifelong learners.
4. Strategic Plan 2013 – Improve Cameron University’s visibility and image locally, regionally and
nationally.
5. Capitalize on Cameron’s multiple levels of academic programs – associate, baccalaureate, and
master’s – to enhance student learning and to increase opportunities for educational
advancement.
Program Quality Improvement Report 2009-2010
3
Measures of Learning and Service Outcomes
1. Direct measures of student-learning or service outcomes
•
•
Portfolio Review
Capstone Course
2. Indirect measures of student-learning or service outcomes
•
•
•
•
•
•
•
Capstone Course
Average of 4 requests for gradates or interns per semester
Statements from Fort Sill’s:
Intern Training Manager
Chief Knowledge officer
Chief, Instructional Systems Design/G3/Analysis Branch
Statements from MMD grads in graduate school
3. Strategies / methodologies that address shortfalls in student learning or
service prior to graduation
•
•
•
•
•
Document deficiencies from AAS Capstone
Students present e-Portfolio to faculty for critique (Oral Presentations)
Recommend READINGS about e-Portfolio construction
Individually mentor or instruct before graduation
Faculty mentors compare AAS & BS portfolio artifacts with students
Program Quality Improvement Report 2009-2010
4
Report on Actions from the Three Previously
Chosen Priority Outcomes
(The outcomes and the actions & Evidence)
•
Provide more structure for students during the development of their
portfolios or services
A. Implementing Spring only Capstone beginning SY 2010-2011 --– See Fall 2010 / Spring 2011 Schedule
B. Implementing oral evaluation of all Capstone II students in Spring 2010 -- Faculty observed the Capstone
class once in Sparing 2010. Full implementation in Spring ‘11
D. Making portfolio quality at least half the Capstone grade -- Implemented – See the Capstone II syllabus
online. Capstone I Syllabus complete and awaiting department certification.
E. Emphasizing the use of artifacts that are desired by potential employers -- Implemented
Program Quality Improvement Report 2009-2010
5.1
Report on Actions from the Three Previously
Chosen Priority Outcomes
(The outcomes and the actions & Evidence)
•
Integrating “Writing for Media” course when developed by Communication
Department —See below
•
Requesting ENGL 2333 in interim while waiting for Communication Dept.-Requested through Curriculum Committee.
•
Advising students to take an advanced course on writing for media -Implemented
•
Developing end of program test for the BS program. --
Under
Development/validation in spring ‘11
Program Quality Improvement Report 2009-2010
5.2
Report on Actions from the Three Previously
Chosen Priority Outcomes … continued
(Multi-year data that indicates improved student learning is occurring)
Semester
Portfolios
Totals
Objectives
Above
Excellent Average Average
1
(Communicate)
AY 2008-09
AY 2009-10
20
13
xx
4
(Target
Audience)
xx
8
(2 Web Tools)
Scale:
4.6 to 5 = Excellent
3.6 to 4.5 = Above Average
xx
2.6 to 3.5 = Average
Program Quality Improvement Report 2009-2010
Below
Average
Poor
Average*
3.00
3.24
2.60
2.83
3.10
3.50
1.6 to 2.5 = Below Average
5.3
Report on Actions from the Three Previously
Chosen Priority Outcomes … continued
(Multi-year data that indicates improved student learning is occurring)
AY
Scale:
Objective No.
Score
Objective No.
Score
Objective
No.
Score
08-09 (20)
1
3.00
4
2.60
8
3.10
09-10 (13)
1
3.24
4
2.83
8
3.50
4.6 to 5 = Excellent
3.6 to 4.5 = Above Average
2.6 to 3.5 = Average
Program Quality Improvement Report 2009-2010
1.6 to 2.5 = Below Average
5.3
Student-learning or service outcomes and
measurements
MEASUREMENT OF PROGRAM OBJECTIVE
PROGRAM
OBJECTIVE 2
Identify and
resolve ethical
and legal
implications of
design in the
work place.
*CURRICULUM
AREA OR TARGET
AUDIENCE
BS in
Multimedia
Design
All courses
Except MM
1143 MM
2034, MM
3013, and MM
4414
Measurements
Direct: Portfolio
Methods used to
determine validity
of measurement
instruments
Methods used
to determine
reliability of
measurements
E-portfolio
Validity:
Criteria
established and
placed in
rubrics.
E-portfolio
Reliability: Eportfolios
measured by
four content
experts
independent
ly.
E-portfolios
measured
based on PO
criteria.
Reinforced in
most courses
in the
curriculum
Schedule for
measurements
After each
semester in
which a
Capstone class
is held
Good interrater
reliability.
* Curriculum area matrices to undergo re-alignment in CY 2011.
Program Quality Improvement Report 2009-2010
7.1
Student-learning or service outcomes and
measurements
MEASUREMENT OF PROGRAM OBJECTIVE
PROGRAM
OBJECTIVE 5
Analyze the
characteristics
of one or two
existing and
emerging
technologies
and their use
in an
instructional,
marketing, or
entertainment
environment.
*CURRICULUM
AREA OR TARGET
AUDIENCE
BS in
Multimedia
Design
All courses
Except MM
1013, MM
1133 MM, and
MM 1143
Reinforced in
most courses
in the
curriculum
Measurements
Direct: Portfolio
Methods used to
determine validity
of measurement
instruments
Methods used
to determine
reliability of
measurements
E-portfolio
Validity:
Criteria
established and
placed in
rubrics.
E-portfolio
Reliability: Eportfolios
measured by
four content
experts
independent
ly.
E-portfolios
measured
based on PO
criteria.
Schedule for
measurements
After each
semester in
which a
Capstone class
is held
Good interrater
reliability.
* Curriculum area matrices to undergo re-alignment in CY 2011.
Program Quality Improvement Report 2009-2010
7.2
Student-learning or service outcomes and
measurements
MEASUREMENT OF PROGRAM OBJECTIVE
PROGRAM
OBJECTIVE 7
Effectively
capture and
edit digitized
graphics,
animation,
audio and
video and
import them
into computerbased and/or
web-based
applications.
*CURRICULUM
AREA OR TARGET
AUDIENCE
BS in
Multimedia
Design
All courses
Except MM
1013, MM
1143, MM
2132, and MM
3203
Measurements
Direct: Portfolio
Methods used to
determine validity
of measurement
instruments
Methods used
to determine
reliability of
measurements
E-portfolio
Validity:
Criteria
established and
placed in
rubrics.
E-portfolio
Reliability: Eportfolios
measured by
four content
experts
independent
ly.
E-portfolios
measured
based on PO
criteria.
Reinforced in
most courses
in the
curriculum
Schedule for
measurements
After each
semester in
which a
Capstone class
is held
Good interrater
reliability.
* Curriculum area matrices to undergo re-alignment in CY 2011.
Program Quality Improvement Report 2009-2010
7.3
Display of assessment data
Semester
AY 2009-2010
#
Portfolios
22
* Scale: 4.6 to 5 = Excellent
Program
Objectives
Excellent
Above
Average
Average
Below
Average
Poor
Average*
2
x
2.85
5
x
3.20
7
x
3.39
3.6 to 4.5 = Above Average
2.6 to 3.5 = Average
Program Quality Improvement Report 2009-2010
1.6 to 2.5 = Below Average
8
Analysis of assessment data
1.
Use a multi-year trend chart to demonstrate level of effectiveness of
the objective over time
AY
Objective No.
Score
Objective No.
Score
Objective
No.
Score
06-07
2
NA
5
2.58
7
1.49
07-08
2
1.40
5
NA
7
NA
09-10
2
2.85
5
3.20
7
3.38
2.
Compare data to Oklahoma and regional institution norms if
available--*No BS programs exist with this CIP code
3.
Compare data to national norms if available--None available
* Researched during 5-Year Program Review, October 2009
Program Quality Improvement Report 2009-2010
9
Action plan for Student-Learning or Service
Outcomes.
Provide more structure for students during the
development of their portfolios or services
A. Holding Capstone courses in the spring only beginning in SY 2010-2011.
B. Implementing an oral evaluation of all Capstone II students in Spring 2011.
D. Making portfolio quality (good artifacts, good reflections and good functionality) at least half the
Capstone grade.
E. Emphasizing the use of artifacts that are desired by potential employers.
F. Requiring use of AAS program projects for Capstone I .
G. Requiring75% of Capstone II projects (6 of 8) must be from Upper Division MMD courses or
internships.
Program Quality Improvement Report 2009-2010
10
Action plan for Student-Learning or Service
Outcomes --Continued
•
Monitor curriculum changes to require a course on writing for media.
( ENGL 2333 in interim.)
•
Continue development/validation of an end of program test for the BS
program.
Program Quality Improvement Report 2009-2010
10.1
Published information on graduates
Academic Year 08-09
Pursuing BS in Multimedia
Pursuing BS in other
Discipline
Entered Graduate
School
Summer 2009 9
Fall 2009
6
Spring 2010
8
Total
17
Working In
Discipline
Unknown
3
1
1
Program Quality Improvement Report 2009-2010
5
5
3
13
3
12