General Education Assessment Oral Discourse and Information Literacy Fall 2007 The University at Albany, SUNY Executive Summary Report Dr. Kristina Bendikas, Interim Director of Program Review and Assessment Institutional Research, Planning & Effectiveness August, 2008 Page 1 Dr. K. Bendikas IRPE Executive Summary In Fall 2007 the University at Albany assessed the degree to which students were achieving the student learning outcomes in Oral Discourse and Information Literacy. As with previous assessments a broad and representative sample of classes representing 20% of the total enrollment in each category was chosen. Faculty were asked to complete Form 1 and 2 and to allow for time at the end of the semester for students to complete the Student Perceptions of General Education Program Course Survey. Completed Form 1s were received from 18 out of the 20 sampled classes (Oral Discourse and Information Literacy combined). Form 2s were received from 17. Results – Oral Discourse The results indicate that the majority of students “met” expectations for all four learning outcomes, and a significant percentage (30.3 - 40.4%) “exceeded.” A very low percentage failed to meet expectations, but for learning Objective 2 (“Students will establish and maintain an appropriate performer/audience relationship in a given oral exercise, and actively engage with listeners/audience”)10.9% only “approached.” When the current results were compared to results from the previous assessment of this category in Fall 2004 it appears that fewer students “exceeded” expectations for all learning outcomes and though the number is small (1.5 – 2.4%) some students “did not meet” expectations. Multiple possible reasons may explain this phenomenon. In addition to variability in faculty grading policies, or the reported results may be due to the fact that different instructors, different disciplinary offerings, and different course materials combined to produce the resulting numbers. Results – Information Literacy The results for information literacy should be interpreted with caution since only four classes participated in the sample and one of those was a class with enrollment that far exceeded the others combined. That may, in part, account for the somewhat uneven results. For example, a vast majority of students “exceeded” expectations for Objective 2 (“Students will understand and use basic research techniques appropriate to the course discipline”) and Objective 4 (“Students will understand the ethical issues involved in accessing and using information”) but only about a quarter exceeded for Objectives 1 (“Students will locate, evaluate, synthesize and use information from a variety of sources”) and Objective 3 (“Students will understand the various ways in which information is organized and structured”). Overall, however, the vast majority of students assessed “met” or “exceeded” expectations for all four learning outcomes. When current results were compared to results from the previous assessment of this category there were significant differences in the percentage of students who “exceeded” expectations, but again the majority met or “exceeded” for each outcome. Of note is the fact that in 2004 and 2007 a significant percentage of students “did not meet”expectations for Objective 1 (“Students will locate, evaluate, synthesize and use information from a variety of sources”). In Fall 2004 12% of Page 2 Dr. K. Bendikas IRPE students assessed “did not meet” expectations for this first learning objective and in Fall 2007 the percentage of students who “did not meet” rose to 17.7%, suggesting the need for further investigation into why students continue to perform relatively poorly in their understanding of “the various ways in which information is organized and structured.” Questions about this assessment, or requests for a full report, should be directed to Dr. Kristina Bendikas, Interim Director of Program Review and Assessment kbendikas@uamail.albany.edu 437-4793. Appendix A Student Learning Objectives Oral Discourse In Oral Discourse courses students will: 1. communicate ideas (creative, expressive, intuitive, intellectual) according to a specific set of criteria 2. establish and maintain an appropriate performer/audience relationship in a given oral exercise, and actively engage with listeners/audience 3. respond to and, where appropriate, incorporate listener's comments and questions 4. critique, orally or in writing, an oral performance Information Literacy Information Literacy courses enable students to: 5. locate, evaluate, synthesize and use information from a variety of sources 6. understand and use basic research techniques appropriate to the course discipline 7. understand the various ways in which information is organized and structured 8. understand the ethical issues involved in accessing and using information Page 3 Dr. K. Bendikas IRPE