STUDENT LEARNING ASSESSMENT PROGRAM
SUMMARY FORM AY 2013-2014
Degree and
Program Name:
Studies Minor
Submitted By:
Robin L. Murray
Please use size 10 font or larger.
Please complete a separate worksheet for each academic program
(major, minor) at each level (undergraduate, graduate) in your
department. Worksheets are due to CASA this year by June
13, 2014. Worksheets should be sent electronically to
kjsanders@eiu.edu and should also be submitted to your college
dean. For information about assessment or help with your
assessment plans, visit the Assessment webpage at
http://www.eiu.edu/~assess/ or contact Karla Sanders in CASA at
581-6056.
PART ONE
What are the learning
objectives?
How, where, and when are they
assessed?
What are the expectations?
What are the results?
1. 1. Film Studies Minor
Students will demonstrate the
ability to understand analyze
and apply critical and
technical language associated
with film studies, including
narrative and non-narrative
forms, mise-en-scene,
cinematography, editing, and
sound.
Midterm and final exam
completed in CMN 3530, Film
Communication. Instructors of
CMN 3530 will share results for
film studies minor students with
the film studies minor advisory
committee
Mean scores of 2.0 or above
(on a 4-point scale) on
midterm and final exam
evaluations
Mean Scores were above 2.0
on the CMN 3530 midterm
and final exam evaluations.
Analytical papers and response
papers completed by film studies
minor students in either required
or elective film studies minor
courses will also provide
evidence that students are
meeting this objective, based on
a rubric designed by our film
studies minor assessment subcommittee. We began
administering these assessments
in fall 2013 to augment the exam
results.
For both fall 2013 and spring
2014, we implemented this
Mean scores of 2.5 or above
(on the same 4-point Likert
scale across rubrics) for
students completing response
papers, oral presentations,
and/or analytical papers in
required and/or elective film
studies minor courses.
At least 50% of film studies
minors completing this
assessment will exceed this
expectation.
Mean scores based on the
rubric results were 3.46
(above 2.5) on the analytical
paper assignment completed
by film studies minors in
FILM 3759 G, CMN 3530,
and ENG 3504. Ninety-two
percent of film studies
minors exceeded this
expectation.
Mean scores based on rubric
results were 3.0 (above 2.5)
on individual response
papers completed by film
studies minors in ENG 3504.
Seventy-seven percent of
film studies minors exceeded
this expectation.
Committee/ person
responsible? How are
results shared?
The Film Studies Minor
Advisory Committee and
the CMN 3530 instructors
(Carrie Wilson-Brown
and David Gracon) are
responsible for sharing
these exam scores.
Overall scores are shared
with the committee and
coordinator.
The Film Studies Minor
Advisory Committee and
instructors teaching either
required or elective film
studies minor courses that
include an analytical
paper, an individual or
group oral presentation,
and/or a response paper
are responsible for
sharing these rubric
scores.
2.Film Studies Minor
Students will demonstrate
their critical thinking and
analytical skills appropriate to
the discipline of film studies
assessment for an analytical
paper in FILM 3759 G (History
of Cinema) and ENG 4904
(Studies in Film), for an analytic
paper in CMN 3530, and for and
analytic paper and response
paper in ENG 3504, Film and
Literature.
Analytical paper completed in
CMN 3530, Film
Communication. Instructors in
CMN 3530 will share results for
film studies minor students with
the film studies minor advisory
committee.
Analytical papers, individual
and/or group oral presentations,
and response papers completed
by film studies minor students in
either required or elective film
studies minor courses will also
provide evidence that students
are meeting this objective, based
on a rubric designed by our film
studies minor assessment subcommittee. We began
administering these assessments
in fall 2013 to augment the CMN
3530 analytic paper assignment.
For both fall 2013 and spring
2014, we implemented this
assessment for an analytical
paper and an individual oral
presentation in FILM 3759 G
(History of Cinema) and ENG
4904 (Studies in Film), for an
analytic paper in CMN 3530,
and for and analytic paper and
response paper in ENG 3504,
Film and Literature.
Mean scores of 2.5 or above
(on a 4-point scale) on
analytical paper evaluations in
CMN 3530.
Mean scores of 2.5 or above
(on the same 4-point Likert
scale across rubrics) for
students completing response
papers, oral presentations,
and/or analytical papers in
required and/or elective film
studies minor courses.
At least 50% of film studies
minors completing this
assessment will exceed this
expectation.
Mean scores of 2.5 or above
(on a 4-point scale) were
achieved on analytical paper
evaluations, response papers,
and individual/group
responses.
Mean scores based on the
rubric results were 3.23 on
the analytical paper
assignment completed by
film studies minors in FILM
3759G, CMN 3530, ENG
3504, and ENG 4904 (above
2.5 for the film studies
minors). Seventy-seven
percent of film studies
minors exceeded this
expectation.
Mean scores based on the
rubric results were 4.0
(above 2.5) on the individual
oral presentations completed
by film studies minors in
ENG 4904. One hundred
percent of film studies
minors exceeded this
expectation.
Mean scores based on rubric
results were 3.0 (above 2.5)
on individual response
papers completed by film
studies minors in ENG 3504.
The Film Studies Minor
Advisory Committee and
the CMN 3530 instructors
(Carrie Wilson-Brown
and David Gracon) are
responsible for sharing
these scores. Overall
scores are shared with the
committee and
coordinator.
The Film Studies Minor
Advisory Committee and
instructors teaching either
required or elective film
studies minor courses that
include an analytical
paper, an individual or
group oral presentation,
and/or a response paper
are responsible for
sharing these rubric
scores.
3. Film Studies Minor
Students will demonstrate
their ability to complete a
research project and apply
appropriate print and nonprint
sources in the film studies
discipline.
Research project completed in
ENG 3504, Film and Literature.
Instructors in ENG 3504 will
share results for film studies
minor students with the film
studies minor advisory
committee.
Analytical papers completed by
film studies minor students in
either required or elective film
studies minor courses will also
provide evidence that students
are meeting this objective, based
on a rubric designed by our film
studies minor assessment subcommittee. We began
administering these assessments
in fall 2013 to augment the ENG
3504 analytic paper assignment.
4. Film Studies Minor
Students will demonstrate
their public presentation and
listening skills
For both fall 2013 and spring
2014, we implemented this
assessment for an analytical
paper in FILM 3759 G (History
of Cinema), ENG 4904 (Studies
in Film), CMN 3530, and ENG
3504, Film and Literature.
Individual and/or group oral
presentations completed by film
studies minor students in either
required or elective film studies
minor courses will also provide
evidence that students are
meeting this objective, based on
a rubric designed by our film
studies minor assessment subcommittee. We began
Mean scores of 2.5 or above
(on a 4-point scale) on research
project evaluations.
Mean scores of 2.5 or above
(on the same 4-point Likert
scale across rubrics) for
students completing analytical
papers in required and/or
elective film studies minor
courses.
Seventy-eight percent of
film studies minors exceeded
this expectation.
Mean scores of 2.5 or above
(on a 4-point scale) were
achieved on research project
evaluations. We are
replacing the research
project evaluation with the
analytic paper assessment
because it includes a
research component
appropriate for all our nonproduction-based film
studies minor courses.
At least 50% of film studies
minors completing this
assessment will exceed this
expectation.
Mean scores based on the
rubric results were 3.08 on
the analytical paper
assignment completed by
film studies minors in FILM
3759G, CMN 3530, ENG
3504, and ENG 4904 (above
2.5 for the film studies
minors). Eighty-five percent
of film studies minors
exceeded this expectation.
Mean scores of 2.5 or above
(on the same 4-point Likert
scale across rubrics) for
students completing individual
and/or group presentations in
required and/or elective film
studies minor courses.
Mean scores based on the
rubric results were 3.125 on
the individual oral
presentations completed by
film studies minors in FILM
3759G and ENG 4904
(above 2.5 for the film
studies minors). Eighty-eight
percent of film studies
minors exceeded this
Mean scores of 2.5 or above in
each category of the Video
The Film Studies Minor
Advisory Committee and
the ENG 3504 instructor
are responsible for
sharing these scores.
Overall scores are shared
with the committee and
coordinator.
The Film Studies Minor
Advisory Committee and
instructors teaching either
required or elective film
studies minor courses that
include an analytical
paper are responsible for
sharing these rubric
scores.
The Film Studies Minor
Advisory Committee and
instructors teaching either
required or elective film
studies minor courses that
include an individual or
group presentation are
responsible for sharing
these rubric scores.
Overall scores are shared
administering these assessments
in fall 2013.
Production Rubric
implemented in CMN 2575,
Field Production Courses.
Fall 2013 and Spring 2014, we
implemented this assessment for
an individual oral presentation in
FILM 3759 G and ENG 4904
Film and Literature with great
success.
At least 50% of film studies
minors completing this
assessment will exceed this
expectation.
expectation.
Mean scores of 2.83 and
above were achieved in each
of the applicable categories
(“Program Open,” “Use of
Visuals,” “Use of Audio,”
“Use of Graphics,” “Use of
Lighting,” “Transitions and
Pacing,” and “Program
Effectiveness”
with the committee and
coordinator.
Mean scores of 3.3 ( above
2.5 on a 4-point scale) were
achieved on response paper
evaluations. One hundred
percent of film studies
minors exceeded this
expectation.
The Film Studies Minor
Advisory Committee and
the ENG 3504 instructor
are responsible for
sharing these scores.
Overall scores are shared
with the committee and
coordinator.
A Video Production assessment
completed by film studies minor
students in CMN 2575, Field
Production, an elective in the
film studies minor, will provide
evidence that students are
meeting this objective in relation
to public presentation of video
projects.
5. Students will demonstrate
their ability to articulate,
through close reading and
writing, their own
worldviews. They will be able
to respond in writing to the
values implied in film texts
through their close readings
and reflections
Written response papers
completed in ENG 3504, Film
and Literature. Instructors in
ENG 3504 will share results for
film studies minor students with
the film studies minor advisory
committee.
Analytical papers and response
papers completed by film studies
minor students in either required
or elective film studies minor
courses will also provide
evidence that students are
meeting this objective, based on
a rubric designed by our film
studies minor assessment subcommittee. We began
administering these assessments
in fall 2013 to augment the
response papers in ENG 3504.
Mean scores of 2.5 or above
(on a 4-point scale) on
response paper evaluations.
Mean scores of 2.5 or above
(on the same 4-point Likert
scale across rubrics) for
students completing analytical
papers or response papers in
required and/or elective film
studies minor courses.
At least 50% of film studies
minors completing this
assessment will exceed this
expectation.
Mean scores based on the
rubric results were 3.46 on
the analytical paper
assignment completed by
film studies minors in FILM
3759G, CMN 3530, ENG
3504, and ENG 4904 (above
2.5 for the 4 film studies
minors). Ninety-two percent
of film studies minors
exceeded this expectation.
The Film Studies Minor
Advisory Committee and
instructors teaching either
required or elective film
studies minor courses that
include an analytical
paper and/or a response
paper are responsible for
sharing these rubric
scores.
Fall 2013 and Spring 2014, we
implemented this assessment for
an response papers in ENG 3504
and analytic papers in FILM
3759 G, CMN 3530, ENG 3504,
and ENG 4904 with great
success.
(Continue objectives as needed. Cells will expand to accommodate your text.)
PART TWO
Describe your program’s assessment accomplishments since your last report was submitted. Discuss ways in which you have responded to the
CASA Director’s comments on last year’s report or simply describe what assessment work was initiated, continued, or completed.
1. Learning Objectives: We were pleased that our program objectives were effective. Based on those objectives and our two reports, we have completed our
initial assessments of student learning in our three required courses: FILM 3759 G, CMN 3530 and ENG 3504, as well as ENG 4904 and, to a certain extent,
CMN 3575. We have also implemented our new rubrics for analytical papers, response papers, and individual/group presentations and implemented them in
FILM 3759 G (History of Cinema), CMN 3530 (Film Communication), ENG 3504 (Film and Literature), and ENG 4904 (Studies in Film).
2. How, Where, and When Assessed: We assessed student learning in these four classes, initiating our new assessments to better demonstrate student
performance on particular objectives.
Since our program’s last assessment report and helpful comments from the CASA Director, we have implemented the three rubrics with the same scale for all
measures (a four-point scale that ranges from “Does Not Meet Expectations” to “Exceeds Expectations). Our assessment sub-committee met during summer
2012, and based on the assignments we had collected from CMN 3530, ENG 3504, and ENG 4904, Studies in Film, we crafted rubrics for response papers,
analytical papers with a research component, and individual/group oral presentations. Instead of developing an overall rubric for elective courses, we were able to
build rubrics for assignments implemented in both required and elective courses. Our film studies minor advisory committee approved these rubrics in the fall of
2012 and given a test run in ENG 3504, Film and Literature that semester. Although we originally planned to implement the rubrics in required courses and
select elective courses in the spring of 2013, because our FILM 3759G course was approved as a third requirement and taught for the first time that spring, we
decided to wait until fall 2013 to implement the rubrics across courses after some informal anchoring of the rubrics with artifacts from ENG 3504 and CMN
3530.
We were able to implement the analytical paper, response paper, and individual/group presentation rubrics in during the fall 2013, and the analytical paper and
individual/group response rubric during spring 2014. We also collected data from one of the elective production courses. When we met with Dr. David Gracon,
he provided a rubric he uses in his CMN 2575, field production courses which fulfilled our criteria. The evidence he provided from his students showed that they
fulfilled our 4th objective, demonstrating their public presentation and listening skills, in relation to film production.
You also suggested the possibility of an exit survey or focus group to gain the student perspective on their curriculum. We began discussing this option during
the fall semester 2013 and plan to compile a survey during fall 2014 have the opportunity to distribute a survey to film studies minors either during Fall 2014 or
Spring 2015 (or both) to collect such information.
3. Expectations: As you suggested, we are using the same scale for our rubric measures. We do have 3 different rubrics but have kept the same Likert scales for
the sake of simplicity. We will include the rubrics with this report. When we implemented our rubrics in the fall 2013 semester, we established minimum
expectations for students meeting our minimum and the percentage exceeding it. We decided that at least 50% should exceed our expectations, and we met our
goal in all five categories.
4. Results: We will implement further analysis now that our rubrics are in place across classes. At this point, we have included the results from the response
paper rubric for ENG 3504, the individual/group response for FILM 3759G and ENG 4904, and the analytic paper for FILM 3759G, CMN 3530, ENG 3504, and
ENG 4904. We decided to include both the “Mean” results for each and the percentage of students exceeding our expectations for each in relation to the objective
being assessed.
5. How Results will be Used: Our advisory committee members teaching film studies minor courses currently do the ratings. Beginning in fall 2013, they
submitted rubric ratings from analytical papers, oral presentations/video productions, and/or response papers, when applicable. We will use this data to help
determine program needs. Based on areas of concern cited by faculty teaching elective courses, we have already added a Cinema History course to our
requirements. Last year you suggested utilizing an on-line depository developed with help from CATS. Our advisory committee will discuss this option during
fall 2014. We will share the data with the advisory committee during summer 2014 and meet early in the fall to discuss the results. Our hope is to engage all
faculty in the assessment process. During our first meeting during fall 2014, we will evaluate how to use these results to improve student learning.
PART THREE
Summarize changes and improvements in curriculum, instruction, and learning that have resulted from the implementation of your assessment
program. How have you used the data? What have you learned? In light of what you have learned through your assessment efforts this year and
in past years, what are your plans for the future?
Although our data shows us that our required courses are serving our minors well, we have two main goals in mind:
1. Upgrading our assessments, so that they not only evaluate performance in more meaningful ways based on rubrics instead of grades, but
also assess students more indirectly through surveys and/or interviews
2. Adding courses to our minor to provide more opportunities to assess student learning in elective as well as required courses.
1. Curricular Improvements:
a) As of fall 2013, we added a History of Cinema Course, FILM 3759G, to our list of required courses. According to the catalogue description,
The course offers a comprehensive yet selective overview of the history of cinema, integrating the basic tools for analyzing film as art. It will
examine how the uses of camera, editing, lighting, sound, and acting contribute to the construction of meaning for audiences, as well as
consider how meaning is filtered through various cultural contexts.
b) In spring 2014, we also rearranged two courses, ENG 3504 and ENG 4904, to provide a sense of sequence to our required courses. Instead of three required
courses at the 3000 level, we now require a general education course (FILM 3759G), a 3000-level film art course (CMN 3530), and a special topics course at the
4000-level (ENG 4904). ENG 3504 is now listed as an elective instead of a required course.
2.
Instructional Improvements:
Based on our examination of course assignments from two required courses (CMN 3530 and ENG 3504) we were able to draft rubrics that could be applied in a
variety of film studies minor courses, both required and elective. During 2013-14, however, we were able to collect data based on these rubrics from four of our
courses—the three required courses and one elective: FILM 3759G, CMN 3530, ENG 3504, and ENG 4904. We plan to analyze data further now that our rubrics
have been distributed and collected. Since these coincide directly with objectives, we will be able to ascertain strengths and weaknesses in how well our program
helps students meet our stated objectives.
Based on initial analysis, our analytic paper and individual/group response assessments seem stronger than the response paper assessment only because we had
fewer rubrics to analyze.
3.
Learning:
Based on the data we have collected from response paper, individual/group presentation, and analytic paper rubrics, the film studies minor students evaluated
seemed to have the most difficulty with our first, second, and third objectives:
1. Film Studies Minor Students will demonstrate the ability to understand, analyze and apply critical and technical language associated with film studies,
including narrative and non-narrative forms, mise-en-scene, cinematography, editing, and sound.
2. Film Studies Minor Students will demonstrate their critical thinking and analytical skills appropriate to the discipline of film studies.
3. Film studies minors will demonstrate their ability to complete a research project and apply appropriate print and non-print sources in the film studies
discipline
Based on the data we collected during 2013-14, we hope to gain more insights about our film studies minor students’ needs. We have 27 declared minors in the
program as of spring 2014, and many of them are just beginning their minor course work, so we have opportunities ahead for data collection and analysis.
We would also like to integrate a goal that addresses global citizenship. We believe we may be able to slightly revise objective 5, so that it better addresses this
learning goal: “Students will demonstrate their ability to articulate, through close reading and writing, their own worldviews. They will be able to respond in
writing to the values implied in film texts through their close readings and reflections.” By adding “and others’” to their own worldviews, we may help students
meet this goal. We can adjust our rubrics accordingly.
Another goal will be to continue working on our course sequencing, as well as adding courses to our curriculum. For example, we are planning to teach a women
and film course under the Humanities prefix during spring 2015. The course will be taught collaboratively with the goal to cross-list it as a women’s studies/film
course in the future. We are also exploring the addition of senior seminar FILM prefix courses to our elective curriculum We would also like to transform our
FILM 3759G course to an online environment.