fiqws writing and information literacy assessment

advertisement
FALL 2010 FIQWS WRITING AND INFORMATION LITERACY ASSESSMENT
January 2011
Assessment of Writing Skills and Information Literacy Skills in FIQWS was conducted
January 13th-January 28th, 2011 by veteran FIQWS composition instructors: Adam
Bubrow, Casey Gordon, MacAdam Smith, Nicole Treska, and Amy Veach. The project
was coordinated by Ana Vasovic, Coordinator for General Education.
Forty final research papers from twenty different FIQWS sections were assessed
(instructors were asked to submit two random papers each) using the General Education
Writing and an Information Literacy rubrics so as to understand where progress has been
made and where struggles still exist in regards to the FIQWS program.
Findings and recommendations
Overall, students’ papers are satisfactory and have improved in clarity and structure from
the previous assessment conducted in Fall 09. Summary of findings and areas that can be
improved are described below:
WRITING
1. Thesis:
An emerging thesis appears in nearly every essay, which is an improvement over
last year’s findings. Students still struggle with articulating the thesis clearly and
creating a thesis statement that merits complex analysis. Thesis statements rarely
articulate opposing viewpoints, because few students develop true, dual-sided,
debatable topics.
2. Structure and Organization:
Introductions and conclusions are in place and competent, though not always
compelling. Every essay has a clear beginning, middle, and end. Organization of
information throughout the body of the essay is weaker. Transitions are most
often missing or ineffective.
3. Evidence and Development:
All students utilized sources related to their topics. Students struggle to really
assess their sources and recognize the bias of the sources. Few students give
counter-arguments. It seems as though students don’t have enough time to
familiarize themselves with the topic and the political landscape about which they
are writing.
4. Mechanics and Style:
Most students are approaching competency in this category. While ESL issues
account for some errors, papers show evidence of difficulty in areas of agreement,
diction, and syntax. In addition to grammar concerns, students at times show
difficulty in articulating complex ideas.
INFORMATION LITERACY
1. Demonstrates a clear understanding of information needs and is able to search
efficiently:
Students show a good variety of sources, some of them from scholarly journals.
Still an over-reliance on Internet sources with no authors specified. Students
struggle with interpreting these sources. Sources are rarely challenged, and often
information is inserted without evaluation.
2. Effectively evaluates information sources:
Students seem comfortable finding sources, and most use at least one scholarly
source. The majority of sources, however, are Internet sources. The credibility of
sources is left unchallenged.
3. Articulates credibility of sources:
The students show very few mentions at all of sources’ credibility, probably
because few experts are used as primary sources. Students mention nothing more
than the name of the author, and often the information is introduced without the
use of any signal phrase.
4. Uses information ethically:
Students seem very conscious of plagiarism and the idea of citations, footnotes,
and bibliographies. Where students struggle is in using the precise format of the
given citation style. Lapses in citation or citation style may be attributed to
students’ lack of skill in documentation rather than ethical issues.
The suggested actions for further improvement are as follows:
-Teachers should introduce strong student essays as examples. Along with sharing the
Writing and Information Literacy Rubrics with students, teachers should produce
examples of Beginning(1), Developing(2), Competent(3), and Accomplished(4) essays.
Those examples may be provided by the teacher, though it was also suggested that
examples be made available directly through the FIQWS program. Perhaps CUNY has
sample papers already in place.
-Content instructors should provide students with clusters of materials to be used as
possible sources for the final papers. While it is important that students learn how to
develop their own, original research question for the final paper, students seemed to have
trouble locating valuable, applicable sources. By asking content instructors to provide
clusters of materials grouped under examples of research paper topics, students could be
more focused in their research, thus learning how to thoroughly analyze and use a source
rather than using a source simply for the sake of fulfilling the requirement of the
assignment.
-Supplemental support for ESL and grammar instruction should be utilized.
Instructors should partner with the Writing Center more actively in trying to reach out to
students struggling with ESL issues (TOEFL certified tutors are available). The idea
of separate ESL FIQWS courses was discussed but ultimately seen as an unfit solution to
the problem, as it would segregate ESL students from the larger student body. Grammar
courseware is available for use at the College.
-Students should be encouraged to use all of the resources offered by the library.
While students seem to be somewhat capable of performing research in the online
databases, little evidence was shown that the students utilized other areas of the library.
Students should be encouraged to look at print sources; students should also feel
comfortable approaching the reference desk for assistance.
-Writing instructors should focus on the value of sources and expertise of the
authors of these sources. One of the most sweeping areas of concern was with the
students’ use of sources. While the content instructor should take lead in guiding
students to quality sources, the writing instructor should refocus his/her energy on
helping students thoroughly analyze sources.
-The plagiarism policy should be clarified for faculty. Many faculty are uninformed
or misinformed about the University’s plagiarism policy and therefore fail to report
plagiarism all together. A FIQWS Faculty handbook will be developed and will
include policies and procedures involving plagiarism.
-Both assessment rubrics should be modified. The Writing Rubric: Suggested
amendments to the language included adding terms such as “development” and
“transition” to the “Structure and Organization” section. It was the feeling of the
assessment team that the sections of each rubric should be divided into more succinct,
observable parts.
-A checklist for students should be composed and posted, along with the rubrics, online
for easy student access. The checklist is currently being composed and is intended for
use as a friendlier version of the rubrics.
In conclusion, it is important to note that the common sentiment was that the papers have
improved in clarity and structure from the previous assessment. The average rubric scores
are shown below and, in comparison with Fall 09 data, they do show an improvement in
students’ writing and information literacy skills.
Note: Scale 1-4 reflects the ability range from the beginning level to the accomplished
level – it is meant as a “college span” scale; it is expected that the majority of freshmen
would not be at the “accomplished” end of the scale.
1 - beginning
2- developing
3 - competent
4 – accomplished
Writing Skills Scores Average
Structure and Evidence and Mechanics
Organization Development and Style
Thesis
Fall 10
2.34
2.41
2.33
2.37
Fall 09
1.86
2.06
2.13
2.10
Information Literacy Scores Average
Understand
info needs/
Evaluate info Credibility of Use info
search
ethically
sources
efficiently sources
Fall 10
2.38
2.19
2.01
2.42
Fall 09
2.23
2.07
1.88
1.99
Download