1. What kinds of assessment processes do you use to determine

advertisement
INSTITUTIONAL EFFECTIVENESS ASSESSMENT EVALUATION
QUESTIONNAIRE
Humanities Division
Bryan Campus
1. What kinds of assessment processes do you use to determine your area’s effectiveness?
The following methods are used for assessment in the English courses:
Workshops/departmental meetings, course inventory tests, syllabi review and revision, and final
grade analysis.
2. Give one recent example of an assessment process you have used in your area and
discuss the measures (direct or indirect) you chose to determine the effectiveness of the
process. The remainder of the questions will pertain to this example.
At the beginning of the Fall 2003 semester and the Spring 2004 semester, this department held
workshops designed (1) to help English instructors ensure they are consistent in the types of
assignments for a course (and consistent with the course syllabus), and (2) to help writing
instructors achieve consistency in grading assignments. Follow-up workshops will be held during
the Spring 2004 semester. All instructors teaching English courses are required to attend. Two
workshops are held each time, one during the day and one in the evening to accommodate
everyone.
3. How did you determine the need for this assessment?
The need for this assessment came mostly from anecdotal evidence from both instructors and
students. The information indicated that some teachers were grading for one element, such as
grammar usage, while others were not grading this element at all. We want all instructors
grading for the same elements (guided by the syllabus and the Department’s official “Grading
Criteria” list). The need was also indicated by an analysis of Final Grades data produced by the
Office of Institutional Research and Effectiveness, which showed some wide deviation among
instructors.
4. How many individuals participated in the identification of these assessment needs? Were
any of these individuals from outside your department or area? If so, please indicate.
The identification of this assessment need was made by the Chair and Assistant Chair of the
Humanities Division.
5. How, and from what sources, did you gather the data necessary to support the
measurement activity described above? Did you use any of the standard reports from the
Office of Institutional Research or make a request for data from that office?
We used several final grade analysis reports as a springboard for discussion on consistency in
assignments and grading. These reports are provided to the Division Chair at the end of each
semester. We also used the current syllabus for each course as a point of discussion. The rest of
the support measurement came form anecdotal discussion among the instructors.
6. How long of a time frame did the data gathering cover?
We used Final Grade Reports from the past three semesters. We plan for this type of assessment
to be a regular activity each long semester.
7. How were the data compiled (in written report, presentation, charts and graphs)? What
types of analytical methods, if any, did you use to determine the nature of the data?
The Final Grade Reports were compiled and provided by the Office of Institutional Research.
Data from these reports were presented on the whiteboard for the whole group and then
discussed. Copies of the current syllabi were given to each participant for group discussion.
8. What did the final data indicate? Were you surprised by the findings?
A discussion on the current syllabi did reveal that not all instructors were following them as
closely as the Division Chair had thought. The instructors were told how important it is to be
sure everyone is teaching the same set of objectives and student outcomes. Analysis and
discussion of the Final Grade Reports indicated some instructors giving an unusually high
amount of A’s and B’s. The number of W grades was also analyzed. More discussion on these
data will take place during individual evaluation conferences with the instructors later this
spring.
9. With whom did you share the results of your assessment activity? Was your vicepresident or other supervisor included in the distribution of results.
No one outside the Division was included in these discussions. The results were not shared with
the vice-president or supervisor.
10. How have you used the results of this assessment activity to make improvements in your
division or area?
We have used the Final Grade Reports in two meetings so far this year. Improvement would be
indicated by more consistency among instructors as shown in these grade reports.
We have used it to improve our instruction and to show students that there is a logical, fair,
identifiable reason for the grade they receive on assignments and in the course.
11. What types of follow-up measure have you established to determine if improvement has
taken place? What time frame (following term, one year later, etc.)?
We expect to continue these workshops/meetings on a regular basis each long semester as long
as there is a need. If our goal is achieved, then we would offer this type of assessment—
workshops, meetings—to only the new instructors when they first come to Blinn to teach
English.
Another way to assess improvement is by the Student Evaluations of each instructor. Meetings
with individual instructors will be held this Spring during which this issue will be discussed.
Download