Multimedia Design Department School of Science & Technology BS in Multimedia Design CIP Code -- 13.0501 Program Quality Improvement Report 2009-2010 1 Student-Learning or Service Outcomes 1. Communicate effectively in visual, oral and written form– Synthesis and Application 2. Identify and resolve ethical and legal implications of design in the work place– Comprehension and Application 3. Conduct a needs assessment– Synthesis 4. Identify and describe target audience – Synthesis 5. Analyze the characteristics of one or two existing and emerging technologies and their use in an instructional, marketing, or entertainment environment– Analysis 6. Select and use a variety of techniques and strategies to define and sequence multimedia content – Analysis and Evaluation 7. Capture and edit digitized graphics, animation, audio and video and import them into computerbased and/or web-based applications– Analysis and Synthesis 8. Demonstrate familiarity with at least one basic and one advanced authoring program or basic and one advanced web authoring tool.– Analysis * Bloom’s taxonomy for Academic programs Program Quality Improvement Report 2009-2010 2.1 Student-Learning or Service Outcomes • Indicate objectives that are required by accrediting agencies o No requirements for accreditation o Program Objectives were derived from Instructional Design Competencies; The Standards, 2nd Edition, ibstpi, Batavia, Il, 1994 (Revised for Academic use) o Ibstpi =International Board of Standards for Training and Instruction Program Quality Improvement Report 2009-2010 2.3 Alignment of Outcomes 1. University Mission– Offer high quality, challenging academic programs that include a global perspective and respond to student and employer needs 2. School Mission – Enhance student opportunities for service learning, to include internships, civic involvement and off-campus educational activities. 3. Program Mission – Develop a reputation for offering career-oriented programs that are distinctive from other universities. These programs will produce graduates who are sought after by business, industry and education, as well as graduates who are lifelong learners. 4. Strategic Plan 2013 – Improve Cameron University’s visibility and image locally, regionally and nationally. 5. Capitalize on Cameron’s multiple levels of academic programs – associate, baccalaureate, and master’s – to enhance student learning and to increase opportunities for educational advancement. Program Quality Improvement Report 2009-2010 3 Measures of Learning and Service Outcomes 1. Direct measures of student-learning or service outcomes • • Portfolio Review Capstone Course 2. Indirect measures of student-learning or service outcomes • • • • • • • Capstone Course Average of 4 requests for gradates or interns per semester Statements from Fort Sill’s: Intern Training Manager Chief Knowledge officer Chief, Instructional Systems Design/G3/Analysis Branch Statements from MMD grads in graduate school 3. Strategies / methodologies that address shortfalls in student learning or service prior to graduation • • • • • Document deficiencies from AAS Capstone Students present e-Portfolio to faculty for critique (Oral Presentations) Recommend READINGS about e-Portfolio construction Individually mentor or instruct before graduation Faculty mentors compare AAS & BS portfolio artifacts with students Program Quality Improvement Report 2009-2010 4 Report on Actions from the Three Previously Chosen Priority Outcomes (The outcomes and the actions & Evidence) • Provide more structure for students during the development of their portfolios or services A. Implementing Spring only Capstone beginning SY 2010-2011 --– See Fall 2010 / Spring 2011 Schedule B. Implementing oral evaluation of all Capstone II students in Spring 2010 -- Faculty observed the Capstone class once in Sparing 2010. Full implementation in Spring ‘11 D. Making portfolio quality at least half the Capstone grade -- Implemented – See the Capstone II syllabus online. Capstone I Syllabus complete and awaiting department certification. E. Emphasizing the use of artifacts that are desired by potential employers -- Implemented Program Quality Improvement Report 2009-2010 5.1 Report on Actions from the Three Previously Chosen Priority Outcomes (The outcomes and the actions & Evidence) • Integrating “Writing for Media” course when developed by Communication Department —See below • Requesting ENGL 2333 in interim while waiting for Communication Dept.-Requested through Curriculum Committee. • Advising students to take an advanced course on writing for media -Implemented • Developing end of program test for the BS program. -- Under Development/validation in spring ‘11 Program Quality Improvement Report 2009-2010 5.2 Report on Actions from the Three Previously Chosen Priority Outcomes … continued (Multi-year data that indicates improved student learning is occurring) Semester Portfolios Totals Objectives Above Excellent Average Average 1 (Communicate) AY 2008-09 AY 2009-10 20 13 xx 4 (Target Audience) xx 8 (2 Web Tools) Scale: 4.6 to 5 = Excellent 3.6 to 4.5 = Above Average xx 2.6 to 3.5 = Average Program Quality Improvement Report 2009-2010 Below Average Poor Average* 3.00 3.24 2.60 2.83 3.10 3.50 1.6 to 2.5 = Below Average 5.3 Report on Actions from the Three Previously Chosen Priority Outcomes … continued (Multi-year data that indicates improved student learning is occurring) AY Scale: Objective No. Score Objective No. Score Objective No. Score 08-09 (20) 1 3.00 4 2.60 8 3.10 09-10 (13) 1 3.24 4 2.83 8 3.50 4.6 to 5 = Excellent 3.6 to 4.5 = Above Average 2.6 to 3.5 = Average Program Quality Improvement Report 2009-2010 1.6 to 2.5 = Below Average 5.3 Student-learning or service outcomes and measurements MEASUREMENT OF PROGRAM OBJECTIVE PROGRAM OBJECTIVE 2 Identify and resolve ethical and legal implications of design in the work place. *CURRICULUM AREA OR TARGET AUDIENCE BS in Multimedia Design All courses Except MM 1143 MM 2034, MM 3013, and MM 4414 Measurements Direct: Portfolio Methods used to determine validity of measurement instruments Methods used to determine reliability of measurements E-portfolio Validity: Criteria established and placed in rubrics. E-portfolio Reliability: Eportfolios measured by four content experts independent ly. E-portfolios measured based on PO criteria. Reinforced in most courses in the curriculum Schedule for measurements After each semester in which a Capstone class is held Good interrater reliability. * Curriculum area matrices to undergo re-alignment in CY 2011. Program Quality Improvement Report 2009-2010 7.1 Student-learning or service outcomes and measurements MEASUREMENT OF PROGRAM OBJECTIVE PROGRAM OBJECTIVE 5 Analyze the characteristics of one or two existing and emerging technologies and their use in an instructional, marketing, or entertainment environment. *CURRICULUM AREA OR TARGET AUDIENCE BS in Multimedia Design All courses Except MM 1013, MM 1133 MM, and MM 1143 Reinforced in most courses in the curriculum Measurements Direct: Portfolio Methods used to determine validity of measurement instruments Methods used to determine reliability of measurements E-portfolio Validity: Criteria established and placed in rubrics. E-portfolio Reliability: Eportfolios measured by four content experts independent ly. E-portfolios measured based on PO criteria. Schedule for measurements After each semester in which a Capstone class is held Good interrater reliability. * Curriculum area matrices to undergo re-alignment in CY 2011. Program Quality Improvement Report 2009-2010 7.2 Student-learning or service outcomes and measurements MEASUREMENT OF PROGRAM OBJECTIVE PROGRAM OBJECTIVE 7 Effectively capture and edit digitized graphics, animation, audio and video and import them into computerbased and/or web-based applications. *CURRICULUM AREA OR TARGET AUDIENCE BS in Multimedia Design All courses Except MM 1013, MM 1143, MM 2132, and MM 3203 Measurements Direct: Portfolio Methods used to determine validity of measurement instruments Methods used to determine reliability of measurements E-portfolio Validity: Criteria established and placed in rubrics. E-portfolio Reliability: Eportfolios measured by four content experts independent ly. E-portfolios measured based on PO criteria. Reinforced in most courses in the curriculum Schedule for measurements After each semester in which a Capstone class is held Good interrater reliability. * Curriculum area matrices to undergo re-alignment in CY 2011. Program Quality Improvement Report 2009-2010 7.3 Display of assessment data Semester AY 2009-2010 # Portfolios 22 * Scale: 4.6 to 5 = Excellent Program Objectives Excellent Above Average Average Below Average Poor Average* 2 x 2.85 5 x 3.20 7 x 3.39 3.6 to 4.5 = Above Average 2.6 to 3.5 = Average Program Quality Improvement Report 2009-2010 1.6 to 2.5 = Below Average 8 Analysis of assessment data 1. Use a multi-year trend chart to demonstrate level of effectiveness of the objective over time AY Objective No. Score Objective No. Score Objective No. Score 06-07 2 NA 5 2.58 7 1.49 07-08 2 1.40 5 NA 7 NA 09-10 2 2.85 5 3.20 7 3.38 2. Compare data to Oklahoma and regional institution norms if available--*No BS programs exist with this CIP code 3. Compare data to national norms if available--None available * Researched during 5-Year Program Review, October 2009 Program Quality Improvement Report 2009-2010 9 Action plan for Student-Learning or Service Outcomes. Provide more structure for students during the development of their portfolios or services A. Holding Capstone courses in the spring only beginning in SY 2010-2011. B. Implementing an oral evaluation of all Capstone II students in Spring 2011. D. Making portfolio quality (good artifacts, good reflections and good functionality) at least half the Capstone grade. E. Emphasizing the use of artifacts that are desired by potential employers. F. Requiring use of AAS program projects for Capstone I . G. Requiring75% of Capstone II projects (6 of 8) must be from Upper Division MMD courses or internships. Program Quality Improvement Report 2009-2010 10 Action plan for Student-Learning or Service Outcomes --Continued • Monitor curriculum changes to require a course on writing for media. ( ENGL 2333 in interim.) • Continue development/validation of an end of program test for the BS program. Program Quality Improvement Report 2009-2010 10.1 Published information on graduates Academic Year 08-09 Pursuing BS in Multimedia Pursuing BS in other Discipline Entered Graduate School Summer 2009 9 Fall 2009 6 Spring 2010 8 Total 17 Working In Discipline Unknown 3 1 1 Program Quality Improvement Report 2009-2010 5 5 3 13 3 12