Executive Summary of the Fall 2007 Oral Discourse and Information Literacy assessment

advertisement
General Education Assessment
Oral Discourse and Information Literacy
Fall 2007
The University at Albany, SUNY
Executive Summary Report
Dr. Kristina Bendikas, Interim Director of Program Review and Assessment
Institutional Research, Planning & Effectiveness
August, 2008
Page 1
Dr. K. Bendikas
IRPE
Executive Summary
In Fall 2007 the University at Albany assessed the degree to which students were achieving the
student learning outcomes in Oral Discourse and Information Literacy. As with previous
assessments a broad and representative sample of classes representing 20% of the total enrollment
in each category was chosen. Faculty were asked to complete Form 1 and 2 and to allow for time
at the end of the semester for students to complete the Student Perceptions of General Education
Program Course Survey. Completed Form 1s were received from 18 out of the 20 sampled
classes (Oral Discourse and Information Literacy combined). Form 2s were received from 17.
Results – Oral Discourse
The results indicate that the majority of students “met” expectations for all four learning
outcomes, and a significant percentage (30.3 - 40.4%) “exceeded.” A very low percentage failed
to meet expectations, but for learning Objective 2 (“Students will establish and maintain an
appropriate performer/audience relationship in a given oral exercise, and actively engage with
listeners/audience”)10.9% only “approached.”
When the current results were compared to results from the previous assessment of this category
in Fall 2004 it appears that fewer students “exceeded” expectations for all learning outcomes and
though the number is small (1.5 – 2.4%) some students “did not meet” expectations. Multiple
possible reasons may explain this phenomenon. In addition to variability in faculty grading
policies, or the reported results may be due to the fact that different instructors, different
disciplinary offerings, and different course materials combined to produce the resulting numbers.
Results – Information Literacy
The results for information literacy should be interpreted with caution since only four classes
participated in the sample and one of those was a class with enrollment that far exceeded the
others combined. That may, in part, account for the somewhat uneven results. For example, a
vast majority of students “exceeded” expectations for Objective 2 (“Students will understand and
use basic research techniques appropriate to the course discipline”) and Objective 4 (“Students
will understand the ethical issues involved in accessing and using information”) but only about a
quarter exceeded for Objectives 1 (“Students will locate, evaluate, synthesize and use information
from a variety of sources”) and Objective 3 (“Students will understand the various ways in which
information is organized and structured”). Overall, however, the vast majority of students
assessed “met” or “exceeded” expectations for all four learning outcomes.
When current results were compared to results from the previous assessment of this category
there were significant differences in the percentage of students who “exceeded” expectations, but
again the majority met or “exceeded” for each outcome. Of note is the fact that in 2004 and 2007
a significant percentage of students “did not meet”expectations for Objective 1 (“Students will
locate, evaluate, synthesize and use information from a variety of sources”). In Fall 2004 12% of
Page 2
Dr. K. Bendikas
IRPE
students assessed “did not meet” expectations for this first learning objective and in Fall 2007 the
percentage of students who “did not meet” rose to 17.7%, suggesting the need for further
investigation into why students continue to perform relatively poorly in their understanding of
“the various ways in which information is organized and structured.”
Questions about this assessment, or requests for a full report, should be directed to Dr. Kristina
Bendikas, Interim Director of Program Review and Assessment kbendikas@uamail.albany.edu
437-4793.
Appendix A
Student Learning Objectives
Oral Discourse
In Oral Discourse courses students will:
1. communicate ideas (creative, expressive, intuitive, intellectual) according to a
specific set of criteria
2. establish and maintain an appropriate performer/audience relationship in a given
oral exercise, and actively engage with listeners/audience
3. respond to and, where appropriate, incorporate listener's comments and questions
4. critique, orally or in writing, an oral performance
Information Literacy
Information Literacy courses enable students to:
5. locate, evaluate, synthesize and use information from a variety of sources
6. understand and use basic research techniques appropriate to the course discipline
7. understand the various ways in which information is organized and structured
8. understand the ethical issues involved in accessing and using information
Page 3
Dr. K. Bendikas
IRPE
Download