2014-2015 GWS assessment report

advertisement
2014-2015 Annual Program Assessment Report
.
College: Humanities
Department: Gender & Women’s Studies
Program: Undergraduate
Assessment liaison: Breny Mendoza
1. Please check off whichever is applicable:
A. ________ Measured student work.
B. ____X_____Analyzed results of measurement.
C. ________ Applied results of analysis to program review/curriculum/review/revision.
2. Overview of Annual Assessment Project
Option B
This academic year assessment focused on the review of online and hybrid courses.
The faculty in the Department of Gender & Women’s Studies have been early
adopters of online teaching at California State University, Northridge. Over time,
online and hybrid versions of most of our GE courses have become widespread in
our department. While online courses were assessed in similar ways to regular faceto-face courses, there was no process to assess online courses on their own terms
until now. Although it had not begun such a process, the Department has already
introduced practices or regulations to enhance student learning that are unique to
our Department, and are a result of our accumulated experience with online
teaching. For example, the Gender and Women’s Studies department requires that
online courses have at least one third synchronous activities in all online courses,
such as Live Chats, to encourage interaction between instructors and students.
Given that discussion and critical enquiry is so crucial to our field, we have ensured
that the quality of a live, discussion-oriented classroom is not lost in the online
format. As more recent research has shown that hybrid courses are pedagogically
preferred for student learning, we also have been moving progressively toward
hybrid courses.
We assessed five online and/or hybrid courses (GWS 100 Introduction to Gender &
Women’s Studies, GWS 300 Women as Agents of Change, and GWS 350 Intersections
of Gender, Race, Class, and Sexuality) taught by five of our core faculty. A careful
examination of the syllabi, SLOs, the course webpage design, student’s work, and
instruction materials was done. The faculty teaching these courses were also
interviewed to get a closer view of the experience of the course as well as their own
assessments of online teaching and learning. Assessment was qualitative and
focused on the quality of teaching and student’s work. The following research
questions guided the assessment process: Are we changing the content of our
courses with the use of technology in online/hybrid courses? Are there changes in
course requirements between online, hybrid and regular face-to-face courses? Are
online students learning at the same pace as students in regular courses?
It is important to note that there are no set guidelines at CSUN for assessment of
online courses. Assessment of online courses at CSUN as well as in other universities
that I researched often limit assessment to the format or design of the course
webpage, but not the ways the content of courses may become modified as a result
of their online format or how online teaching may affect student learning. This
preliminary assessment of online teaching and learning in the GWS department
does not purport to remedy these limitations. It also does not pretend to fully
answer the research questions abovementioned or address in great depth how
online teaching is affecting our teaching or student learning. It does, however, want
to go a bit further than just a surface analysis of the course webpage as well as
identify some of the most important trends that are observable in a preliminary
assessment.
Conclusions






There is a great disparity among the faculty regarding course web design as
well as course delivery that depends on the level of competency with online
teaching. While some of our faculty have exemplary course designs, following
all the best practices of online teaching to engage students, others have more
rudimentary course set ups. This may be attributed to the fact that perhaps
not all faculty have received proper training or have the same level of
experience or expertise with online teaching.
Syllabi were well designed by all faculty, including good course descriptions
that provided a good picture of the content of the course, course objectives,
and pertinent SLOs, but in some cases the course webpage design did not
reflect the content of the syllabus. A minimalist approach was preferred in
many cases that made the course webpage difficult to comprehend or
navigate for the reviewer and it must be assumed also for the students.
Not all student work was accessible electronically in all courses as some
faculty still graded hard copies or do not use Moodle for grading.
Some faculty are able to use a variety of software for online teaching that
helped students not only navigate the course with great ease, but also to
experiment with alternative ways of learning with the use of blogs, selfsnapshots, conceptual glossaries etc.
The delivery of online courses varied across the board. Some faculty
members provided power point lectures every week accompanied by other
activities such as forums, quick internet researches, and Live Chats, but most
did not provide power point lectures. In the weeks that students do not have
Live Chats or in-class sessions students are left to their own devices to
understand the material. Some faculty used discussion forums every week
while other spaced them out throughout the semester.
Some faculty used knowledge surveys at the beginning and end of the course
to assess student learning.




While all courses met the writing requirements prescribed by the university,
the number of pages required in formal research papers has gone down
slightly over time. Nonetheless, faculty believe that this lower page count on
formal writing assignments was compensated by online students doing more
writing than students in face-to-face courses because of the writing involved
in forums, blogs etc. Multiple-choice tests are also becoming standard in
many cases, perhaps due to software availability.
Because of the nature of online teaching conceptual thinking may become
more difficult to learn as discussion forums, multiple-choice testing and
shorter term papers are slowly becoming the norm.
This assessment made visible the need to revisit the content sequence and
chunking of information that each course must deliver. Approximately ten
years ago, our department had conducted an assessment of all our GE and
core courses, and delineated concepts, materials, information that must be
covered by each particular course. Over time, and with changes in the field
and our own SLOs, it is apparent that we should revisit those course
differentials and update them.
Online courses tend to be left out of class evaluations and peer reviews. But
as a result of this assessment, we are now in the process of designing
evaluation forms specific for online and hybrid courses.
Recommendations
 Create incentives and requirements for faculty to attend online
instruction courses so that all students can benefit equally from the
advantages of online learning. Internal workshops in which more
experienced faculty teach the less experienced are also desirable.
 Have a retreat in which we discuss the findings of this preliminary
assessment and revisit general course requirements in terms of
conceptual frameworks that should be taught in lower and upper division
courses.
 Create more opportunities for faculty to evaluate the curriculum, our
pedagogies, and the impact of online teaching in our ways of delivering
content.
 Carry out opinion surveys for faculty and students regarding their
experiences of online teaching and learning.
 Set a minimum of online courses that are to be evaluated per year, per
faculty.
 Revisit the five year plan to expand assessment of online and hybrid
courses.
3. Preview of planned assessment activities for next year.
This year a new assessment liaison will carry out the task of assessment. She will
revisit the five-year plan with the help of the previous liaison to continue with
assessment of online courses and other changes that may emerge from this revision.
This will be presented in the next faculty meeting for discussion and approval.
Download