1 DATE: October 1, 2007 TO: Kathy Ho, Ph.D. Chair, Senate Outcomes Assessment Committee FROM: Henrik Borgstrom, Ph.D Chair, Department of Modern and Classical Languages RE: 2005-2007 Department Outcomes Assessment Report Attached, please find the assessment report for the Department of Modern and Classical Languages over the period 2005-2007. The report details the findings for 17 graduating seniors with a major in Spanish, and 6 graduating seniors with a major in French. The primary assessment instrument is the senior seminar capstone course, which culminates in an extended research paper and an oral defense before a committee of faculty. At least two faculty members with expertise in the student’s target language are responsible for assessing each student, according to a list of general rubrics, attached. Assessment rubrics for language proficiency guidelines, as established by the American Council on the Teaching of Foreign Languages, were not implemented in our department until the spring of 2007; therefore the report includes only the findings from one graduating cohort. Similarly, data for the number of students who have studied abroad was not collected until the spring of 2007, and data has never yet been collected for the number of students who plan to continue their study at the graduate level. These will all be included in the next assessment report. Summary of Findings The report finds that, over the period 2005-2007, 76% of graduating seniors in Spanish and 100% of graduating seniors in French were able to analyze a problem and synthesize a solution by conducting appropriate research; 76% of graduating seniors in Spanish, and 100% of graduating seniors in French demonstrated the ability to engage in critical thinking; 71% of graduating seniors in Spanish and 100% of graduating seniors in French demonstrated an understanding of core concepts, research methods, and analytic frameworks; 72% of graduating seniors in Spanish and 100% of graduating seniors in French demonstrated a global awareness of their target culture’s presence in the world. 2 Conclusions and Actions: The findings for the graduating seniors with a major in French are likely skewed, since these students are assessed by only one full-time faculty member with a terminal degree. For future assessment, the department will consider inviting an outside scholar with a terminal degree in French. This is dependent upon the university’s willingness to cover any expenses thus incurred. More attention needs to be given to students’ writing and research skills, especially in Spanish. The department will implement ACTFL writing rubrics in all advanced courses in history, literature, and culture. Formal writing rubrics will be used for all papers, and students will be offered more opportunities for revising and rewriting papers. Although this attention to writing proficiency already takes place in courses taught by full time faculty, very little written work is done in upper-division courses taught by part-time faculty. Part-time faculty have little incentive to spend the time necessary to administer writing intensive courses; yet the department does not have enough full-time faculty to cover all upper-division courses. In order to strengthen students’ writing, all upperdivision courses should be taught by full-time faculty with a terminal degree. The department will request the addition of one full-time faculty line in Spanish. Minor programs and non-major courses Assessment of language proficiency in the minor programs in Spanish and French, and in elementary language courses in Spanish, French, Italian, Japanese, Chinese, Latin, Greek, and American Sign Language is embedded within individual courses. All syllabi in the Department of Modern and Classical Languages require the clear articulation and assessment of the department’s mission, and the individual student learning outcomes for each course. A number of course syllabi for non-major courses do not articulate satisfactorily the assessment of student learning outcomes; all instructors with deficient syllabi will be asked to revise their syllabi accordingly. 3 The Mission of the Department of Modern and Classical Languages is to develop in all interested students the ability to communicate across national and cultural borders through linguistic proficiency and global awareness of other peoples and societies OUTCOMES ASSESSMENT PLAN FOR MAJORS IN SPANISH AND FRENCH Student Learning Assignment or Activity Examiner Outcomes Students will demonstrate senior seminar oral defense, At least two faculty advanced proficiency in oral using ACTFL*proficiency members with expertise in communication in the target rubrics the student's target language language. and thesis topic. Students will demonstrate senior seminar project or At least two faculty advanced proficiency in honors thesis members with expertise in written communication in the student's target language the target language. and thesis topic. Students are able to analyze a problem and synthesize a solution by conducting appropriate research thesis proposal; faculty-supervised research over one or two semesters. Students are able to integrate emerging technologies into research and communication. annotated bibliography demonstrating knowledge of various research databases. Students will demonstrate an understanding of core concepts, research methods and analytic frameworks. Finished thesis as reviewed by a panel of three faculty members in the student's chosen field. Students will demonstrate the ability to engage in critical thinking. Students will demonstrate a global awareness of their target culture's presence in the world. Students will have first-hand experience with their target culture and language. Students will seek to continue their studies at the graduate level. senior seminar project or honors thesis, with an oral defense before a committee. senior oral defense before a committee At least two faculty members with expertise in the student's chosen topic At least two faculty members with expertise in the student's target culture. study abroad experience Percentage of majors who study abroad. Percentage of majors accepted into graduate programs in language, education, international relations, or other related fields. * The American Council on the Teaching of Foreign Languages 4 ASSESSMENT OF GOALS REPORTED FOR YEARS 2005-2007 Please use one page for each goal. DEPARTMENT: Modern and Classical Languages Type of Goal: _x_ Department/Program Student Learning Outcome ___ Gen Ed Student Learning Outcome ___ Department Goal ___ Strategic Plan Goal ___ Other________________ GOAL: Students will demonstrate advanced proficiency in oral communication in the target language. Explain how this goal is linked to Mission/Enabling Goals, Strategic Plan, General Education Goals, College Mission/Goals, and/or Sector Goals as appropriate. College Outcome: Demonstrated ability to communicate effectively in the discipline. DATA USED TO ASSESS OUTCOMES: Senior seminar oral presentation in the target language before faculty; assessment rubrics based on ACTFL guidelines. This assessment instrument was used for the first time in 2007. We have no data previous to 2007. OUTCOMES ACHIEVED (Findings and Conclusions): Of five graduating seniors in Spanish, three students achieved advanced proficiency; two achieved intermediate high proficiency. Of two graduating seniors in French, one achieved advanced proficiency, one achieved intermediate high proficiency. ACTIONS TAKEN AND/OR DESIRED AS A RESULT OF OUTCOMES (Continuous Improvement): The Department will offer students more opportunities for oral communication and practice in all advanced literature and culture courses. The department will offer advanced grammar courses in the summer, designed specifically for rising senior majors and education majors. The Department will request the addition of one full-time faculty line in language. ACTFL oral proficiency rubrics will be implemented in all advanced literature and culture courses. POTENTIAL RESOURCE IMPLICATIONS (Savings, Expenses, New Revenue) *OPTIONAL* new full-time faculty line in language Date: 10/1/07 Person Submitting: Henrik Borgstrom 5 ASSESSMENT OF GOALS REPORTED FOR 2005-2007 Please use one page for each goal. DEPARTMENT: Modern and Classical Languages Type of Goal: _x_ Department/Program Student Learning Outcome ___ Gen Ed Student Learning Outcome ___ Department Goal ___ Strategic Plan Goal ___ Other________________ GOAL: Students will demonstrate advanced proficiency in written communication in the target language. Explain how this goal is linked to Mission/Enabling Goals, Strategic Plan, General Education Goals, College Mission/Goals, and/or Sector Goals as appropriate. College Outcome: Demonstrated ability to communicate effectively in the discipline. Demonstrated ability to use the information literacy skills, including research skills, appropriate to the major Demonstrated awareness of key concepts, theories, and/or knowledge in the discipline DATA USED TO ASSESS OUTCOMES: Senior seminar thesis in the target language before faculty; Assessment rubrics based on ACTFL guidelines. This assessment instrument was used for the first time in 2007. We have no data previous to 2007. OUTCOMES ACHIEVED (Findings and Conclusions): Of five graduating seniors in Spanish, three students achieved advanced proficiency, two achieved intermediate high proficiency. Over 2005-2007 in Spanish, 23% of graduating seniors achieved a score of “poor” for the ability analyze a problem and synthesize a solution by conducting appropriate research; 35% achieved a score of “good”, and 41% achieved a score of “excellent”. 29% of graduating seniors in Spanish achieved a score of “poor” for demonstrating an understanding of core concepts, research methods and analytic frameworks; 53% achieved a score of “good”; 18% achieved a score of “excellent” 29% of graduating seniors in Spanish achieved a score of “poor” for expressing themselves clearly and concisely using appropriate terms and language; 41% achieved a score of “good”; 23% achieved a score of “excellent” Of two graduating seniors in French, one achieved advanced proficiency, one achieved intermediate high proficiency. Over 2005-2007 in French, 50% of graduating seniors achieved a score of “good” for the ability to analyze a problem and synthesize a solution by conduction appropriate research; 50% achieved a score of “excellent” 50% of graduating seniors in French achieved a score of “good” for demonstrating an understanding of core concepts, research methods and analytic frameworks; 50% achieved a score of “excellent” 83% of graduating seniors in French achieved a score of “good” for expressing themselves clearly and concisely using appropriate terms and language; 33% achieved a score of “excellent” 6 ACTIONS TAKEN AND/OR DESIRED AS A RESULT OF OUTCOMES (Continuous Improvement): The Department will offer students more opportunities for written communication and practice in all advanced literature and culture courses. The department will offer advanced grammar courses in the summer, designed specifically for rising senior majors and education majors. ACTFL writing rubrics will be implemented for all written assignments in advanced literature and culture courses. The Department will request the addition of one full-time faculty line in language. POTENTIAL RESOURCE IMPLICATIONS (Savings, Expenses, New Revenue) *OPTIONAL* New full-time faculty line in language. Date: 10/1/07 Person Submitting: Henrik Borgstrom 7 ASSESSMENT OF GOALS REPORTED FOR 2005-2007 Please use one page for each goal. DEPARTMENT: Modern and Classical Languages Type of Goal: _x_ Department/Program Student Learning Outcome ___ Gen Ed Student Learning Outcome ___ Department Goal ___ Strategic Plan Goal ___ Other________________ GOAL: Students will demonstrate the ability to engage in critical thinking Explain how this goal is linked to Mission/Enabling Goals, Strategic Plan, General Education Goals, College Mission/Goals, and/or Sector Goals as appropriate. College Outcome:. Demonstrated ability to engage in critical thinking appropriate to the discipline. DATA USED TO ASSESS OUTCOMES: Senior seminar thesis and oral defense before faculty. OUTCOMES ACHIEVED (Findings and Conclusions): In Spanish, 23% of graduating seniors achieved a score of “poor”; 35% achieved a score of “good”; and 41% achieved a score of “excellent”. In French, 50% of graduating seniors achieved a score of “good”; 50% achieved a score of “excellent”. ACTIONS TAKEN AND/OR DESIRED AS A RESULT OF OUTCOMES (Continuous Improvement): no actions taken POTENTIAL RESOURCE IMPLICATIONS (Savings, Expenses, New Revenue) *OPTIONAL* Date: 10/1/07 Person Submitting: Henrik Borgstrom 8 ASSESSMENT OF GOALS REPORTED FOR 2005-2007 Please use one page for each goal. DEPARTMENT: Modern and Classical Languages Type of Goal: _x_ Department/Program Student Learning Outcome ___ Gen Ed Student Learning Outcome ___ Department Goal ___ Strategic Plan Goal ___ Other________________ GOAL: Students will demonstrate a global awareness of their target culture’s presence in the world. Explain how this goal is linked to Mission/Enabling Goals, Strategic Plan, General Education Goals, College Mission/Goals, and/or Sector Goals as appropriate. College Outcome:. Able to integrate and apply key principles and concepts in the major field. DATA USED TO ASSESS OUTCOMES: Senior seminar thesis and oral defense before faculty and student interview. OUTCOMES ACHIEVED (Findings and Conclusions): In Spanish, 18% of graduating seniors achieved a score of “poor”; 59% achieved a score of “good”; 23% achieved a score of “excellent”. In French, 67% of graduating seniors achieved a score of “good”; 33% achieved a score of “excellent” ACTIONS TAKEN AND/OR DESIRED AS A RESULT OF OUTCOMES (Continuous Improvement): POTENTIAL RESOURCE IMPLICATIONS (Savings, Expenses, New Revenue) *OPTIONAL* Date: 10/1/07 Person Submitting: Henrik Borgstrom 9 ASSESSMENT OF GOALS REPORTED FOR 2005-2007 Please use one page for each goal. DEPARTMENT: Modern and Classical Languages Type of Goal: _x_ Department/Program Student Learning Outcome ___ Gen Ed Student Learning Outcome ___ Department Goal ___ Strategic Plan Goal ___ Other________________ GOAL: Students will have a first-hand experience with their target culture and language. Explain how this goal is linked to Mission/Enabling Goals, Strategic Plan, General Education Goals, College Mission/Goals, and/or Sector Goals as appropriate. College Goal: An internationalized experience and supportive climate for all students. The preparedness of graduates for careers in the new economy DATA USED TO ASSESS OUTCOMES: Number of graduating majors who have studied abroad. This assessment instrument was used for the first time in 2007. We have no data previous to 2007. OUTCOMES ACHIEVED (Findings and Conclusions): Of five graduating seniors in Spanish, three studied abroad, two did not. Of three graduating seniors in French, three studied abroad. ACTIONS TAKEN AND/OR DESIRED AS A RESULT OF OUTCOMES (Continuous Improvement): The department will continue to encourage students to study abroad, and will offer additional scholarships to students who wish to study abroad, through the Palisano Language Laboratory Grant. POTENTIAL RESOURCE IMPLICATIONS (Savings, Expenses, New Revenue) *OPTIONAL* The Palisano Language Laboratory grant, received in May, 2007, includes $3000 which is dedicated to $500 mini grants for study-abroad. Date: 10/1/07 Person Submitting: Henrik Borgstrom 10 Senior Student Outcomes Assessment French PERIOD: 2005-2007 (6 students assessed) Student is able to analyze a problem and synthesize a solution by conducting appropriate research. not at all poor 50% not at all poor Student is able to demonstrate the ability to engage in critical thinking. good 50% not at all poor Student demonstrates an understanding of core concepts, research methods, and analytic frameworks. good excellent 50% excellent 50% excellent 100% not at all poor Student express him/herself clearly and concisely, using appropriate terms and language. good 83% not at all Student demonstrates a global awareness of their target culture's presence in the world. Senior Student Outcomes Assessment Spanish good (17 students assessed) poor good 67% PERIOD: 2005-2007 excellent 16% excellent 33% 11 Student is able to analyze a problem and synthesize a solution by conducting appropriate research. not at all not at all Student is able to demonstrate the ability to engage in critical thinking. not at all Student demonstrates an understanding of core concepts, research methods, and analytic frameworks. not at all Student express him/herself clearly and concisely, using appropriate terms and language. not at all Student demonstrates a global awareness of their target culture's presence in the world. poor good 23% 35% poor good 23% 35% poor good 29% 53% poor good 29% 41% poor good 18% 59% excellent 41% excellent 41% excellent 18% excellent 29% excellent 23%