Library instruction evaluation tools

advertisement
Library Instruction Evaluation
Tools Used in the Florida State
University Library System
BY CAROL MAKSIAN
FLORIDA GULF COAST UNIVERSITY
DECEMBER 15, 2008
Why do we need assessment?
 Internal Review – Anecdotal evidence is common, but
how do we know if we’re succeeding in our instructional
programs?
 Feedback to Instructional Faculty – What did we teach
their students in the short time that we had them?
 Part of an internal review. What can we do better to
make our instruction program first-class?
 Accreditation – Accrediting agencies now focus on
instructional outcomes. What have students gained from
instruction? Have they learned?
Per Jim Alderman, UNF. Slide 5 of One Shot to Teach One Shot to Assess
presentation for the PSPC Information Literacy Subcommittee meeting
February 14, 2008.
Southern Association of Colleges & Schools
3.8.2 The institution ensures that users have access to regular and timely instruction
in the use of the library and other learning/information resources.
Rationale and Notes:
To ensure appropriate use of the library and other learning/information resources, the
institution is expected to provide timely and effective access to the library/learning resources
that enables students, faculty and staff to take full advantage of the learning resources provided
by the institution.
Relevant Questions for Consideration:
• What is the objective and the type of assistance available to learning/information resource users?
• What delivery mechanisms exist for instruction and assistance to library users and how are they
assessed?
• How does the institution determine the effectiveness of its learning/information resource
programs?
Sample Documentation:
• Documentation of the availability and type of instruction
• Documentation of the assessment of the instruction
• Reports of library instructional activity that demonstrate broad participation in the instructional
program by all segments of the institution at all teaching locations
p. 59 of Resource Manual for the Principles of Accreditation: Foundations for Quality
Enhancement
How are Florida Universities Assessing
Their Instructional Programs?
The following survey of Florida State University
Libraries was taken during the week of December 8,
2008 using Checkbox survey software.
7 libraries participated in the survey:
FAMU, FGCU, FIU, FSU, NCF, UCF, USF
Polytechnic
Two libraries: UNF and USF sent current assessment
documents or drafts.
FAMU -- No
FGCU -- No
FIU -- Yes
FSU -- No
NCF -- No
UCF -- Yes
USF Polytechnic -- Yes
FAMU -- No
FGCU -- Yes
FIU -- No
FSU -- Yes
NCF -- Not created one
yet
UCF -- Some use own
USF Polytechnic -- Yes
FAMU -- No
FGCU -- May tailor
surveys for a class
FIU -- No
FSU -- No
NCF -- Not created one
yet – 1st year classes are
ver y different from
senior seminars.
UCF -- No
USF Polytechnic -- No
If you do not evaluate all classes,
which classes do you sample?
FAMU -- Paper
FGCU -- Paper. (We
have done a couple of
web surveys.)
FIU -- Paper
FSU -- Paper
NCF -- Not created one
yet
UCF -- Depends on
librarian
USF Polytechnic -Paper
Has anyone had problems
implementing a web evaluation?
FAMU -- In class
FGCU -- In class
FIU -- 8-15 days
FSU – After class, 1-7
days
NCF -- At the end of the
semester
UCF -- In class
USF Polytechnic -- In
class
When do you think is the best time
to administer an evaluation?
FAMU -- No
FGCU -- May tailor
surveys for a class
FIU -- No
FSU -- No
NCF -- Not created one
yet – 1st year classes are
ver y different from
senior seminars.
UCF -- No
USF Polytechnic -- No
Do you get feedback from all of the library instruction
sessions taught or do you do just get samples?

I get feedback from all the First Year Experience classes, but the rest of the
undergraduate classes do not give me feedback. FSU
 All. USF Polytechnic
 Most feedback is done verbally by the students or the professor. NCF
 We get a very good sample usually several for each library instructor, for
each grade level and across disciplines. FIU
 Feedback is received from all of the library instruction sessions FAMU
 Usually it is just samples. However, we do collect evaluations from certain
courses. UCF
 We do not get feedback from all classes, just samples. FGCU
How you have used or plan to use these evaluative tools to
improve library instruction?
 I am presently working on a pre/post test for the FYE classes.
We have a librarian who in charge of assessment and our
committee is developing tests. I did another version of a
pre/post test and did not think it was focused so we are
redeveloping another. FSU
 Adjusted level of details and content USF Polytechnic
 We have just developed a QEP (Quality Enhancement
Program) for 1st year students to improve writing and
research skills. There will be some type of assessment at the
end of these QEP classes but that assessment is still in the
design stage. NCF
How you have used or plan to use these evaluative tools to
improve library instruction?
 For FIU, we send all classes a single evaluation form but other
types of evaluation are done by individual librarians including
minute papers, correcting assignments, pre-post tests,
classroom response systems, and bibliography analysis.
 Librarians use these tools to gain a better understanding of
what students learned during the presentation and use
comments to help improve their instruction. Most of the tools
used are primarily level 1 -- reaction and how did they like the
presentation. A few questions may address level 2--learning
but not many. FGCU
Do you report the findings to
administration or your supervisor?
Other Comments
 I think we do not do enough assessment in our classes. I would like to






assess every class or at least do a great deal more.
Want to create electronic one for faculty requesting the session
Seeing other evaluation forms being used at various institutions will be
helpful in developing ours.
Since we send our evaluations a week or more after the library session, we
are impressed to see the overwhelming number of comments we get that
specifically address class content. Apparently, they were listening. :)
Our library instruction survey for students will be electronically
administered using Survey Monkey during the next semester
We are continually trying to improve them.
We have used various tools to assess instruction classes. While the forms
are not very detailed, generally instructors have learned something from
each one. I do not think we need to reinvent the wheel with regards to
assessment and would like to know about successful tools librarians have
used in their classes.
Current /Draft Evaluation tools
of Florida SULs
PLEASE GO TO:
PSPC INFORMATION LITERACY
SUBCOMMITTEE WIKI
HTTP://INFOLITFLORIDA.PBWIKI.COM/
Download