Annual Progress Report on Assessment of Student Learning for Undergraduate Programs (Rev 09/09) Academic year: 2008-2009 Department/Program: Music Degree program(s): Bachelor of Music Education (CIP Code 13.1312) Person(s) preparing report: Dr. Frederick Burrack, Director of Graduate Studies Date submitted: In one paragraph, summarize your 2008-2009 Annual Progress Report Provide the web link to department web site where degree program SLOs, Alignment Matrix, and 20082009 APR Summary are posted http://www.k-state.edu/music/ 1) List the complete set of Student Learning Outcomes for your Program (all SLOs identified for your program) Outcome #1 Outcome #2 The teacher of music has skills in teaching and evaluation techniques. The teacher of music has skills in improvising melodies, variations, and accompaniments. The teacher of music has skills in composing and arranging music. The teacher of music has skills in reading and performing music. The teacher of music has skills in listening to, analyzing, and describing music. The teacher of music has skills in evaluating music and music performances. The teacher of music has an understanding of music in relation to various historical periods and cultures. The teacher of music has skills in establishing effective music-learning environments. The teacher of music advocates for the school music program in the community at-large. Outcome #3 Outcome #4 Outcome #5 Outcome #6 Outcome #7 Outcome #8 Outcome #9 2) Identify the Student Learning Outcomes (from the full list above) that were assessed for this Annual Progress Report. All outcomes. 3) What assessments were used for each learning outcome? Please include results of the assessments and the sample of students from whom data were collected. Outcome #1 The teacher of music has skills in teaching and evaluation techniques. INSTRUCTIONAL UNIT PLAN: assessed during student teaching Percent of Candidates at Each Score Value Year N 2005-2006 2006-2007 2007-2008 2008-2009 13 9 13 14 0-42 43 44-49 50 15% 11% 8% 7% 7% 51-55 56 15% 11% 23% 22% 7% 57-61 62 22% 70% 56% 69% 57% DATA SUMMARY AND REFLECTION Scores for outcome #1 illustrate that all 12 of the 14 candidates achieved at or above the highest category of Mastery (56). One student achieved in the level of proficient, and one student achieved below the basic level. This student demonstrated competence but did not submit a completed assessment so the low score does not actually reflect competence or learning, but possibly attitude. Students overall are achieving well within this outcome area. It is worth noting that those who scores in the mastery level were truly outstanding in all ways. Outcome #2 The teacher of music has skills in improvising melodies, variations, and accompaniments. IMPROVISATION PROJECT: assessed during MUSIC 511 Percent of Candidates at Each Score Value Academic Number of Students Year 12 6 23 10 2005-2006 2006-2007 2007-2008 2008-2009 Unsatisfactory < 70% 17% ------9% 0% Developing (basic) 70%-79% 25% 34% 0% 0% Acceptable (proficient) 80%-89% 25% 44% 0% 30% Mastery (exemplary) 90% < 33% 34% 91% 70% DATA SUMMARY AND REFLECTION Scores for candidates on the improvisation project illustrate that all of the candidates achieved above the acceptable level level. Improvemet has been made to bring a greater number of students into the proficient to examplary range but this is acceptable performance. IMPROVISATION ON PIANO: assessed during Piano Proficiencies Percent of Candidates at Each Score Value Academic Number of Students Year 13 2008-2009 Unsatisfactory < 70% 0% Developing (basic) 70%-79% 8% Acceptable (proficient) 80%-89% 38% Mastery (exemplary) 90% < 54% DATA SUMMARY AND REFLECTION This assessment has been an intergral part of the achievement expectations of the music education program for as long is it has been in existence, but the scores have not been associated with the SLO process prior to 2008. The scores indicate that candidates are demonstrating successful improvisation of piano accompaniment of melodies as illustrated by 92% receiving at the acceptable level or above. Outcome #3 The teacher of music has skills in composing and arranging music. COMPOSITION PROJECT (MUSIC PreK-12): assessed in MUSIC 360 Percent of Candidates at Each Score Value Academic Number of Students Year 32 6 11 21 2005-2006 2006-2007 2007-2008 2008-2009 Unsatisfactory < 70% 4% 16% 0% 9% Developing (basic) 70%-79% 4% 17% 0% 5% Acceptable (proficient) 80%-89% 18% 50% 0% 38% Mastery (exemplary) 90% < 74% 17% 100% 48% DATA SUMMARY AND REFLECTION Scores for candidates on the composition project illustrate that 86% of the candidates have achieved at the level of Proficient or above. PRAXIS THEORY SCORE (MUSIC PreK-12): assessed on the nationally normed PLT exam Percent of Candidates at Each Score Value Academic Number of Students Year 16 11 14 22 2005-2006 2006-2007 2007-2008 2008-2009 Unsatisfactory 1st quartile Developing (basic) 2nd quartile Acceptable (proficient) 3rd quartile Mastery (exemplary) 4th quartile 13% 8% 14% 5% 63% 58% 36% 73% 25% 25% 21% 9% 0% 8% 29% 14% DATA SUMMARY AND REFLECTION Scores for candidates on the music theory portion of the PRAXIS exam required of all students in music teacher education. This exam is taken during their student teaching, at least one or more years following their last theory course. The scores are calculated using all examinees taking this test in the United States during the testing period. Scores indicate that students have improved over the past years with 50% scoring higher than the national mean. Outcome #4 The teacher of music has skills in reading and performing music. JURIED PERFORMANCE (MUSIC PreK-12): assessed in the Fall semester juries Percent of Candidates at Each Score Value Academic Number of Students Year (all music education students) Unsatisfactory < 70% Developing (basic) 70%-79% Acceptable (proficient) 80%-89% Mastery (exemplary) 90% < DATA SUMMARY AND REFLECTION Scores for candidates on the juried performance in the fall semester have not been maintained prior to 2009 but will be included from this point on to provide more data on student achievement. JURIED PERFORMANCE (MUSIC PreK-12): assessed in the Spring semester juries Percent of Candidates at Each Score Value Academic Number of Students Year (all music education students) 84 84 89 74 2005-2006 2006-2007 2007-2008 2008-2009 Unsatisfactory < 70% 4% ------2% 0 Developing (basic) 70%-79% 4% 6% 4% 2% Acceptable (proficient) 80%-89% 18% 33% 21% 22% Mastery (exemplary) 90% < 74% 61% 73% 76% DATA SUMMARY AND REFLECTION Scores for candidates on the juried performance illustrate that all but one student achieved at least a passing score (70%) with 98% achieving in the Proficient and Exemplary levels, which is the a slight improvement over the former year. The scores at the Mastery level did increase by 3% over the former year and has remained in the same are for 3 out of the past 4 years. It is unknown why the number of students has decreased in this area. We must look in the future to see if there is a trend because the numbers in the other assessments associated with senior level courses do not seem to change radically. Division by Studio 2008-2009 Number of Studio String Piano Wind Percussion Voice Students 3 8 33 5 26 Unsatisfactory < 70% --------Incomplete 5% Developing 70%-79% ----3% ----- Acceptable 80%-89% --25% 27% --18% Mastery 90% < 100% 75% 70% 100% 77% Outcome #5 The teacher of music has skills in listening to, analyzing, and describing music. TEACHING UNIT PROJECT (MUSIC PreK-12): assessed in Music 670 Percent of Candidates at Each Score Value Academic Number of Students Year 5 18 13 6 2005-2006 2006-2007 2007-2008 2008-2009 Unsatisfactory < 70% ------------------- Developing (basic) 70%-79% 20% 11% 8% 17% Acceptable (proficient) 80%-89% 20% 28% 15% 33% Mastery (exemplary) 90% < 60% 61% 77% 50% DATA SUMMARY AND REFLECTION Scores for candidates on the teaching unit project illustrate that 100% of the candidates have achieved at least a passing score (70%) with 83% achieving in the Proficient and Examplary levels. This assignment acts as a cumulative transfer of all areas of their university training to classroom instruction. It is encouraging to see that a consistent 50% are attaining in the Mastery (examplary) level functioning up to and beyond our expectations for student teachers, although this percentage is lower than in former years. The assessment was made more rigorous which may account for this difference, but a more likely reason is the small number of student in this particular year. SCORE ANALYSIS PROJECT (MUSIC PreK-12): assessed in Music 517 & 518 Percent of Candidates at Each Score Value Academic Number of Students Year Unsatisfactory < 70% 17 2008-2009 ------- Developing (basic) 70%-79% 0% Acceptable (proficient) 80%-89% 0% Mastery (exemplary) 90% < 100% DATA SUMMARY AND REFLECTION Scores for candidates on the teaching unit project illustrate that 100% of the candidates have achieved in the Examplary level. This assignment acts as a cumulative transfer of music theory and historical style into instructional preparation. Outcome #6 The teacher of music has skills in evaluating music and music performances. CURRICULUM/REPERTOIRE SELECTION PROJECT: assessed in MUSIC 670 Percent of Candidates at Each Score Value Academic Number of Students Year 5 13 13 9 2005-2006 2006-2007 2007-2008 2008-2009 Unsatisfactory < 70% ----------8% 11% Developing (basic) 70%-79% -----15% 8% ----- Acceptable (proficient) 80%-89% -----15% 15% ----- Mastery (exemplary) 90% < 100% 62% 77% 89% DATA SUMMARY AND REFLECTION Scores for candidates on the curriculum/repertoire selection project illustrate that all but one of the candidates have achieved at master level (89%). What is not indicated is that half of the master level were near the proficient level. This is an improvement from former years. The range of the scores thus far demonstrate stability in student proficiency. Outcome #7 The teacher of music has an understanding of music in relation to various historical periods and cultures. HISTORY RESEARCH ESSAY: assessed in MUSIC 532 Percent of Candidates at Each Score Value Academic Number of Students Year 10 19 24 24 2005-2006 2006-2007 2007-2008 2008-2009 Unsatisfactory < 70% 10% 26% 12.5% 8% Developing (basic) 70%-79% 10% 11% 21% 21% Acceptable (proficient) 80%-89% 60% 21% 29% 25% Mastery (exemplary) 90% < 20% 42% 37.5% 46% DATA SUMMARY AND REFLECTION Scores for candidates on the historical research essay shows an improvement from the former year. The data illustrates that 92% of the candidates have achieved at least a minimum passing score of 70% (compared to 87.5% the year prior) with 71% achieving in the Proficient and Examplary levels (as compared to 66.5% the year prior). PRAXIS HISTORY SCORE: nationally normed assessment Percent of Candidates at Each Score Value Academic Number of Students Year 12 16 14 22 2005-2006 2006-2007 2007-2008 2008-2009 Unsatisfactory 1st quartile 25% 31% 21% 18% Developing (basic) 2nd quartile 50% 31% 36% 32% Acceptable (proficient) 3rd quartile 25% 25% 21% 27% Mastery (exemplary) 4th quartile 0% 13% 21% 23% DATA SUMMARY AND REFLECTION Scores for candidates on the music history portion of the PRAXIS exam required of all students in music teacher education. This exam is taken during their student teaching, at least one or more years following their last theory course. The scores are calculated using all examinees taking this test in the United States during the testing period. Scores indicate that students have improved over the past years with 42% scoring higher than the national mean. Outcome #8 The teacher of music has skills in establishing effective music-learning environments. CLASSROOM MANAGEMENT PLAN Percent of Candidates at Each Score Value Developing Acceptable Mastery Academic Unsatisfactory Number of Students Year < 70% (basic) 70%-79% (proficient) 80%-89% (exemplary) 90% < DATA SUMMARY AND REFLECTION Scores from this assignment has not been collected for SLOs prior to 2009 but will be added as an additional view of student understanding and proficiency. CLASSROOM MANAGEMENT ON PORTFOLIO Percent of Candidates at Each Score Value Developing Acceptable Mastery Academic Unsatisfactory Number of Students Year 10 15 13 14 2005-2006 2006-2007 2007-2008 2008-2009 < 70% 10% 20% 8% 7% (basic) 70%-79% 10% ---------------- (proficient) 80%-89% 60% 7% 8% ------ (exemplary) 90% < 20% 67% 84% 93% DATA SUMMARY AND REFLECTION Scores for candidates on the classroom management section of the portfolio illustrate that students demonstrated an understanding elements of classroom management as associated with the specific classrooms in the student teaching experience. Outcome #9 The teacher of music advocates for the school music program in the community atlarge. STUDENT HANDBOOK PROJECT Percent of Candidates at Each Score Value Developing Acceptable Mastery Academic Unsatisfactory Number of Students Year 5 13 20 11 2005-2006 2006-2007 2007-2008 2008-2009 < 70% ----------5% 9% (basic) 70%-79% 20% ----------9% (proficient) 80%-89% 20% ----------18% (exemplary) 90% < 60% 100% 95% 64% DATA SUMMARY AND REFLECTION Scores for candidates on the student handbook project illustrate that there has been a decrease in the Exemplary level of achievement but when looking at proficient and above, the percentages remain relatively similar. The student that did not achieve above the 70% did not submit the assignment on time which was a pattern. He did not pass the course. ADVOCACY BROCHURE Percent of Candidates at Each Score Value Developing Academic Unsatisfactory Number of Students Year Did not use this assessment 16 23 9 2005-2006 2006-2007 2007-2008 2008-2009 < 70% -----6% 12% ------ (basic) 70%-79% -----6% ----------- Acceptable (proficient) 80%-89% ----------10% ------ Mastery (exemplary) 90% < -----88% 78% 100% DATA SUMMARY AND REFLECTION Scores for candidates on the advocacy brochure project illustrate that there has been an increase in the Exemplary level of achievement but when looking at the scores at a microscopic level, 50% were at the pivot point between Acceptable and Exemplary. Either way you look at the data, students are achieving at acceptable levels. 4) What was learned from the assessment results? (What do they tell you about student learning? What did you learn about strengths and weaknesses of your program?) An acceptable number of students are meeting the expectations of the program. Although we would like all of our student to reach the Proficient achievement level or higher, which as been reached in some assessment categories, the levels achieved document program rigor and student achievement. 5) What actions and/or revisions were implemented in response to the assessment results and the effects on student learning observed on this year’s SLOs. Actions/Revisions to be implemented as a result of the assessments 1. Skills in teaching & evaluation techniques 2. Skills in improvising 3. Skills in composing and arranging 4. Skills in reading and performing 5. Skills in listening to, analyzing, and describing 6. Skills in evaluating 7.Understands music in relation to various historical periods and cultures 8. Skills in establishing effective music-learning environments 9.Advocates for the school music program Scoring procedures were reviewed and will be made more rigorous. The assessment tool is under review for the following year and will be standardized to better meet the requirement of the expectation of the teaching standard. An additional assessment has been added. No changes in the present assessment. No changes in the present assessment. An additional assessment has been added documenting both semesters of juries. No changes in the present assessment. An additional assessment has been added. No changes in the present assessment. No changes in the present assessment. No changes in the present assessment. An additional assessment has been added. No changes in the present assessment. 6) Describe the process by which faculty reviewed the results of this year’s SLOs. The results were presented in advance of a faculty meeting and the following issues were discussed: The division faculty reviewed the data in January and the entire faculty reviewed the data in February of 2010.