Program Assessment Plan American University SIS: International Affairs: International Economic Relations - MA SIS: International Affairs: International Economic Relations - MA Contact Person for Arturo Porzecanski Assessment: Primary Department: Intl Econ Rel. Does 2014 report reflect No changes in your LOs? : Are there any changes in your Yes assessment method?: Learning Outcome: Facts and Concepts in International Trade & Finance Students shall master basic facts and concepts in international trade and financial relations. Outcome Year: 2013-2014 2014-2015 Start Date: 08/26/2013 End Date: 05/08/2015 Outcome Status: Active Learning Outcome Assessment Plan Assessment Method Target Schedule/Cycle Active Examine random sample of capstone papers from SIS 665 (International Trade and Investment Relations) and final exams from SIS 666 (International Monetary and Financial Relations). Measure Type: Final Paper/ Final Project At least 70% satisfactory or better using rubric that looked at knowledge of basic facts, mastery of relevant policy debates, measured as "poor," "satisfactory," or "excellent." We started this in Spring 2012, and will continue in 2012-13 academic year. No Quiz given at the start of the first day of class, and identical quiz again at the end of the last day of class, to see what progress students have made during the semester. Students take the quiz on a no-name, anonymous basis on both occasions, and they are not told on the first day of class that they will be retaking the same quiz at the end of the semester. Measure Type: Quiz/ Exam Every semester starting with Spring 2014 All students in the core IER class semester. "International Economics," SIS-616, regardless of whether they are IER students (usually about one-third of the class) or from other programs. Two sections of SIS-616 are offered in both the Fall and Spring semesters. Yes Related Action Steps * Supporting Assessment: Evaluation of capstone papers and final exams Description: We discussed the importance of students' drawing out broader implications of policy issues and cases, broadening their understanding of major policy debates, and developing a deeper understanding of the literature. On monetary and financial relations, we agreed faculty teaching 666 would try to evaluate critical thinking skills in the final exam and make sure opportunities for students to develop those skills are present in the classroom. In our discussion of the course and its results, we also agreed it would be useful to give students an opportunity to use their quantitative skills in classes beyond their required methodology courses. Professor Tuomi, who teaches 666, agreed to add a research assignment that would give students a chance to use quantitative analysis. We agreed on a few other changes as a result of this process. First, we agreed to change objective 4 to two objectives. One would focus on mastery of basic facts, and 12/12/2014 3:35 PM Generated by TracDat a product of Nuventive. Page 1 of 4 the other will be "Demonstrate critical thinking about central policy debates." Learning Outcome: Major Schools of Thought in International Economics Students shall become able to describe and distinguish among the major schools of thought in international economics and international political economy. Outcome Year: 2012 or prior 2012-2013 2013-2014 2014-2015 Start Date: 11/17/2010 End Date: 09/30/2013 Outcome Status: Active Learning Outcome Learning Outcome: Research Projects Students shall develop and execute research projects that integrate theoretical insights and empirical evidence, primarily through analytical and writing skills. Outcome Year: 2012 or prior 2012-2013 2013-2014 2014-2015 Start Date: 11/17/2010 End Date: 09/30/2013 Outcome Status: Active Learning Outcome Assessment Plan Assessment Method Target At least 70% of students achieve Direct measure: SRP papers. Faculty members will review the SRPs each spring using a rubric of specific criteria, and "satisfactory" or better. scores of "excellent," "satisfactory," and "poor." Measure Type: Written Assignment 12/12/2014 3:35 PM Generated by TracDat a product of Nuventive. Schedule/Cycle Active This was active in 2009-2010. It may be No revisited in future. We collected data in spring, and discussed results then, and in September program meeting, where we determined adjustments to the curriculum to improve areas where we were weak. Page 2 of 4 Assessment Plan Assessment Method Target Schedule/Cycle The assessment activity we are conducting for AY 2012/13 is to read and evaluate the four Practicum Reports that were presented to our practicum sponsors in April 2013, as part of a new capstone experience available to candidates for the M.A. degree -- an alternative to their writing an SRP (Substantial Research Paper). The full-time faculty will read the Practicum This is our first time and we shall discuss how often to do this. reports and evaluate them along the following lines: Active Yes 1) In what ways and to what extent were the learning objectives of the IER Program advanced, met and/or demonstrated by these reports? 2) In what ways and to what extent were the learning objectives of the IER Program NOT advanced, met and/or demonstrated by these reports? Practica are led by faculty mentors who hold class sessions weekly. Students also 3) How does the faculty intend to use our participate in hands-on workshops designed to enhance their project management, client findings to improve future practicum written relations, oral presentation and writing skills. In addition to sharing the findings with presentations, by making changes to other their clients, students present their reports at the SIS Practica Symposium each semester. elements of the IER program (e.g., prior course content and class assignments)? Measure Type: Final Paper/ Final Project Since this is such a new activity and assessment, we do not yet have the benchmark or goal that we would like to reach in order to know that the learning outcome has been met, but we expect that this initial assessment exercise will enable us to develop concrete targets for next year. The Practicum is designed to give second-year master's students real world experience in project management and consulting while preparing them for post-graduate careers. Students work in teams with expert clients including U.S. and international government agencies, non-profit organizations and businesses to conduct policy and program analysis. Students draw on their substantial research, as well as qualitative and quantitative skills, to prepare final oral and written analysis and recommendations. Indirect measure: Feedback from Zoomerang survey of graduating students. No target identified. Measure Type: Survey Data will be collected each May, and results No will be discussed by faculty in the September field meeting, where we will determine adjustments to the curriculum to improve areas where results are weak. Related Courses - SIS-673- - Comparative Political Economy Learning Outcome: Speaking Skills Students shall develop speaking skills so they can clearly and effectively convey their knowledge. Outcome Year: 2012 or prior 2012-2013 2013-2014 2014-2015 Start Date: 11/17/2010 End Date: 09/30/2013 Outcome Status: Active Learning Outcome Assessment Plan Assessment Method 12/12/2014 3:35 PM Target Generated by TracDat a product of Nuventive. Schedule/Cycle Page 3 of 4 Active Assessment Plan Assessment Method Target Schedule/Cycle Active We wanted to see the average score in each We will hold this research conference each No Graduate Student Research Conference spring. Beginning in Spring 2011, we invited IER students to present a major research paper to a category to be about 3 (out of 5). panel of five IER faculty members. Each student had 10 minutes to present, followed by 10 minutes of Q&A. The faculty scored each presentation on a scale of 1-5 (1 is the lowest, 5 is the highest) in the following categories: ability to succinctly state the research question; clear explanation of key findings; persuasiveness about academic significance and/or policy relevance of findings; professional quality of presentation (appropriate dress, oral delivery and articulation, visual aids); ability to answer questions directly and thoughtfully. Measure Type: Other 12/12/2014 3:35 PM Generated by TracDat a product of Nuventive. Page 4 of 4