Executive Summary Assessment of Student Learning and Development University Assessment Council For AY2011-12 Assessment in Higher Education Redux Back in 1999, Celia Lopez, of the Higher Learning Commission, predicted that the “public demand for educational accountability will continue to require colleges, universities and systems of higher education to document and improve student learning” (1999, p. 6). After 14 years, the demands for the assessment and improvement of what students are actually learning – confirming educational value – are soundly with us. No fad, this. Regional accreditation organizations, government agencies, and discipline and professional accreditation groups continue to require evidence of student learning outcomes. Even more than meeting accountability mandates, the essential goal of assessment is to improve the quality of student learning by improving the practices that impact learning. This process begins with setting clear expectations for student learning and development (learning outcomes) that are consonant with our mission. The assessment process continues with the gathering of meaningful information that demonstrates student accomplishment of institutional, departmental, and classroom expectations. The assessment “loop” is complete only when the information gained from this process informs planning and decision-making in each and every department and results in constructive change. The assessment reports prepared in the summer of 2012 by academic departments demonstrate, as in the reports from previous years, that the majority of faculty at Concordia University are reflecting on their practice as teachers and improving the curriculum and the quality of student learning. Academic majors and graduate programs at Concordia University continue to include a wide range of assessment activities, for example, internships, portfolios, performances, exhibitions, business plans, comprehensive exams, and research projects. In addition, an increasing number of faculty are using the University’s assessment management system to document and aggregate individual student performance measures, and to analyze patterns of performance across the major. Assessment of learning in the academic major in traditional programs continues to be a strength for Concordia University. Most departments were able to document their efforts to review evidence of the learning that had taken place in majors and graduate programs, and then, where there were disappointments or concerns about the outcomes, to honestly deliberate about how to improve the depth, quality, or other aspects of that learning. Some departments indicated that they are making or considering changes in pedagogy, course content, learning objectives, or assessment measures in response to assessment results. Above all, it appears that where assessment has seemed to have had the greatest impact, faculty members have engaged in collegial discussions around the common goal of improving the quality of students’ learning, Despite the challenges of limited personnel and other resources, most faculty are finding ways to review evidence of student learning and development, analyze and discuss its implications, and make changes intended to improve the quality of that learning. For the most part, faculty reported that students are satisfactorily meeting the goals and objectives set for academic programs, despite continuing significant variability in the quality of students’ performances. General Education and University Outcomes General Education at Concordia University is defined as the set of required curriculum that exposes students to a variety of content and disciplines. University Outcomes are those academic, professional, and personal skills and dispositions that are commensurate with a university degree. Again this year, as we have seen each year for as long as we have been collecting annual reports, many departments noted that students’ writing skills in particular needed improvement. In previous executive summaries, intentions to address student writing skills across the institution were recorded, but no systematic program to that effect has yet been carried out. The General Education Committee collected assessment reports from academic departments that provide traditional courses to meet general education requirements. Each department has identified two University Outcomes that general education courses in their area will address and measure during the semester. The reports indicate how well students in those courses are meeting those outcomes and what kinds of improvements are planned to increase the quality of student performance on those outcomes. One thing that can be noted from these reports is that not all departments are intentionally addressing and measuring the University Outcomes they’ve chosen. Some faculty have mentioned informally that they aren’t sure how to teach to these outcomes or how to incorporate them into their content area. Others express concern that they don’t have time in their courses to work with students whose performance on these outcomes is so far behind that of other students. Regarding documentation, not all course section instructors are entering their measurements of student achievement into the assessment management system to be aggregated with the others. This challenge makes the data that we do have of limited use, since there are large swaths of student performance results that are not known. A summary of these University Outcomes assessment reports for general education courses is in the matrix that follows. In addition to general education courses, several University Outcomes are revisited and measured as part of some academic majors and graduate programs. The Assessment Council is working to collect updated Curriculum Maps for all the majors and graduate programs so that the University can document how the University Outcomes are being addressed across an entire degree program. Learning and Development in the Academic Major Academic departments document their assessment activities and use of assessment results for improvement in an annual assessment report for each major or graduate program. A total of 39 assessment reports for 2011-12 were completed for undergraduate academic majors and graduate programs. Appendix III is a summary of Concordia University faculty plans for improvement in academic programs based on assessment of students’ achievement of established learning outcomes. Recommendations: Evidence of an effective University assessment process would be further supported if the Deans were to use this Executive Summary to develop college and program goals that reflect faculty conclusions about needed improvements for student learning. Such goals could be evidence of the kind of data-driven decision-making that the Higher Learning Commission is looking for. 2. Based on faculty reports, an institution-wide effort to improve student writing, especially writing that is far behind expected “grade-level,” is very much needed. 1. 3. 4. Continued encouragement of faculty by supervisors to use the University’s assessment management system (eLumen) is needed. In order to see the full value of this system for the documentation needed for accreditation and improvement, more student performance data needs to be included. Ongoing training on the effective use of the assessment management system should be developed and provided to deans, department chairs, faculty, and adjunct faculty. Reference: Lopez, C.L. (1999). Assessing student learning: Why we need to succeed. Assessment and Accountability Forum, Summer 1999, 5-7/18.