University General Education Curriculum Committee Assessment Project Frequently Asked Questions Why does the university assess the General Education Program? The university is assessing the General Education Program not only because it is a Southern Association of Colleges and Schools (SACS) expectation, but also because it is an expectation we have for ourselves as a university. Assessment of student learning outcomes is a national expectation in higher education and with this expectation is a call for increased accountability. As such, assessment of student learning is something that is and will continue to be important to us. The plan implemented by the General Education Curriculum Committee was only a first step in this process, developed to be expanded and improved in the years to come. Alignment to the Southern Association of Colleges and Schools – Commission on Colleges (SACS-COC) SACS-COC Comprehensive Standard 3.3.1 The institution identifies expected outcomes, assesses the extent to which it achieves these outcomes, and provides evidence of improvement based on analysis of the results in each of the following areas: 3.3.1.1 educational programs, to include student learning outcomes SACS-COC Comprehensive Standard 3.5.1 The institution identifies college-level general education competencies and the extent to which students have attained them. (http://www.sacscoc.org/pdf/2012PrinciplesOfAcreditation.pdf) Connection to the Kentucky Statewide General Education Assessment Plan (Effective 2012) All Kentucky public universities and KCTCS colleges are expected to assess, in accordance with SACS-COC Principles of Accreditation and based upon nationally accepted standards, the student learning outcomes associated with their general education programs, indicate the relationship to the faculty-generated Statewide General Education Student Learning Outcomes, and provide evidence of ongoing assessment that ensures comparability for transfer purposes on a three-year cycle. (http://cpe.ky.gov/NR/rdonlyres/3E8FDECA-4769-4B84-8194A3AE2A60239C/0/StatewideGenEdAssessmentPlanFinal.pdf) Do instructors of General Education courses have to take part in this assessment project? Yes. This process is a very important responsibility for the university, its units, and departments; it is not optional. SACS clearly requires that we assess learning outcomes in our General Education Program, and the necessity to maintain and improve upon our current system cannot be understated. Failure to assess General Education courses places the university accreditation in jeopardy. The impact of such a failure cannot be underestimated. Who is responsible for the assessment process? This process is and will remain the responsibility of the faculty. While a number of administrators have been involved in developing this plan to make sure it is consistent with the expectations of SACS and others who work in assessment, the plan was ultimately developed by the faculty General Education Curriculum Committee, and they have the responsibility for implementing the plan, reviewing the results of the assessment, and overseeing the implementation of the unit and department plans for improvement. While the plan will evolve over time, the preeminent role of the faculty in this process will not change. Is each general education course assessed every semester? No. The assessment process covers different content areas each semester, determined by the Assessment Subcommittee of the General Education Curriculum Committee. Is this process going to measure or evaluate individual instructors or students? No. This process does not assess individual faculty members, students or courses. Its goal is to assess student learning in the General Education Program as a whole. Student and instructor anonymity in the process will be safeguarded. How does the process ensure anonymity? The course instructor or a representative from each academic department, working with the office of General Education Assessment, is responsible for collecting documents for assessment and coordinating the removal of any identifying markers. Aggregate results from each assessment are presented to departments as feedback on student learning across general education content areas. What kinds of course materials are used for the assessment? Work submitted as part of the instructional substance (“embedded artifacts”) from current General Education courses will be evaluated as part of the assessment. These embedded artifacts will assure that the assessment considers work produced with the seriousness that the students bring to any graded work. This assessment framework does not require a standardized test, thus avoiding pressure on the curriculum and the possibility of compromising academic freedom in order to meet the expectations of an external test. What General Education competencies are assessed and why? The General Education Curriculum Committee decided on a system of assessment that would use holistic readings of sample papers, projects, and other course assignments aligned with the General Education learning outcomes. The initial phase of assessment focused on the three broad learning outcomes listed in the first paragraph of the General Education Program description, as emphasized here: “The General Education Program at the University of Louisville fosters active learning by asking students to think critically, to communicate effectively, and to understand and appreciate cultural diversity.” The General Education Curriculum Committee, in consultation with other faculty members, has designed rubrics to measure effective communication, cultural diversity, and critical thinking. The critical thinking rubrics are subdivided into three areas: social sciences, natural sciences, and mathematics. The rubrics were designed by drawing on the outcomes listed for those areas in the General Education Program Description. Are the rubrics available? Yes, the rubrics and scoring criteria are always available for review at http://louisville.edu/provost/GER/rubrics. In addition, the rubrics and scoring criteria are provided to departments before they are assessed. Individual instructors are also directed to the General Education student learning outcomes and the assessment rubrics before each semester. Who collects the information and documents for assessment? The Office of General Education Assessment (contact information below) will handle the collection of information and documents for assessment. Each instructor will be asked to submit an electronic copy of the assignment prompt given to students, and an ungraded, unmarked copy of the selected students’ responses to the Office. How does the process work? In the fall of 2010 and in collaboration with the College of Education and Human Development (CEHD), LiveText was adopted as the general education assessment platform. LiveText is an electronic outcomes assessment system designed specifically to support postsecondary education institutions as they implement and actively review results of student learning outcomes assessment. CEHD has been successfully using LiveText for outcomes assessment for ten years, and representatives from the CEHD worked with the GECC to adjust the general education assessment process to take advantage of the platform. The use of this system allows the submission and assessment of all assignments and student samples electronically, saving time and other valuable resources. Departments are notified of their selection for assessment by the GECC at least one academic semester in advance. LiveText demonstrations for department chairs can be scheduled as a way of familiarizing each department with the assessment process. After the university date for withdrawal without academic penalty, instructors teaching in the topical area under assessment receive a marked course roster indicating which students have been systematically selected to submit embedded artifacts for assessment. Instructors may select any assignment for assessment. As soon as the assignment is submitted by the selected student, instructors provide the Office the following materials: An electronic copy of the assignment sheet distributed to students. An electronic ungraded, unmarked copy of the selected students’ responses to the assignment. All identifying information (student name, faculty/instructor name, course number) should be redacted from assignments and student papers before they are submitted to the Office. The Office will confirm receipt of these materials and will be responsible for uploading these materials to LiveText, where the anonymity of students and instructors will be maintained, and the documents will be prepared for the scheduled assessment reading. Who selects the readers? The deans of all colleges with students in the General Education program are asked to recommend readers to the GECC. What kind of time commitment are readers expected to make? The readers are expected to participate in a half-day training session and a full-day of assessment reading. The training is mandatory to ensure validity and reliability of assessment measures. How are the readers compensated? Readers receive $150 for the half-day of training and $350 for the full-day of reading. How are the readers trained? Training is conducted by members of the GECC along with other university faculty with assessment experience and expertise. What happens to the data? Once the readings are complete, the General Education Assessment Office generates an assessment report, which is presented to the GECC. The committee uses the report to evaluate whether changes should be recommended for the General Education Program. A report about the assessment process is presented to SACS as part of the accreditation process. Are individual student artifacts or course performance available for review after the assessment? No. For anonymity to be maintained, no individual artifacts or individual course performance data is available. Where can I direct other questions? Questions can be directed to the Office of General Education Assessment. Katie Shanahan Director of General Education Assessment Undergraduate Affairs (502) 852-8113 katie.shanahan@louisville.edu Christine Wiggins-Romesburg General Education Assessment Coordinator Undergraduate Affairs (502) 852-7865 cawigg01@exchange.louisville.edu