Library Instruction Evaluation Tools Used in the Florida State University Library System BY CAROL MAKSIAN FLORIDA GULF COAST UNIVERSITY DECEMBER 15, 2008 Why do we need assessment? Internal Review – Anecdotal evidence is common, but how do we know if we’re succeeding in our instructional programs? Feedback to Instructional Faculty – What did we teach their students in the short time that we had them? Part of an internal review. What can we do better to make our instruction program first-class? Accreditation – Accrediting agencies now focus on instructional outcomes. What have students gained from instruction? Have they learned? Per Jim Alderman, UNF. Slide 5 of One Shot to Teach One Shot to Assess presentation for the PSPC Information Literacy Subcommittee meeting February 14, 2008. Southern Association of Colleges & Schools 3.8.2 The institution ensures that users have access to regular and timely instruction in the use of the library and other learning/information resources. Rationale and Notes: To ensure appropriate use of the library and other learning/information resources, the institution is expected to provide timely and effective access to the library/learning resources that enables students, faculty and staff to take full advantage of the learning resources provided by the institution. Relevant Questions for Consideration: • What is the objective and the type of assistance available to learning/information resource users? • What delivery mechanisms exist for instruction and assistance to library users and how are they assessed? • How does the institution determine the effectiveness of its learning/information resource programs? Sample Documentation: • Documentation of the availability and type of instruction • Documentation of the assessment of the instruction • Reports of library instructional activity that demonstrate broad participation in the instructional program by all segments of the institution at all teaching locations p. 59 of Resource Manual for the Principles of Accreditation: Foundations for Quality Enhancement How are Florida Universities Assessing Their Instructional Programs? The following survey of Florida State University Libraries was taken during the week of December 8, 2008 using Checkbox survey software. 7 libraries participated in the survey: FAMU, FGCU, FIU, FSU, NCF, UCF, USF Polytechnic Two libraries: UNF and USF sent current assessment documents or drafts. FAMU -- No FGCU -- No FIU -- Yes FSU -- No NCF -- No UCF -- Yes USF Polytechnic -- Yes FAMU -- No FGCU -- Yes FIU -- No FSU -- Yes NCF -- Not created one yet UCF -- Some use own USF Polytechnic -- Yes FAMU -- No FGCU -- May tailor surveys for a class FIU -- No FSU -- No NCF -- Not created one yet – 1st year classes are ver y different from senior seminars. UCF -- No USF Polytechnic -- No If you do not evaluate all classes, which classes do you sample? FAMU -- Paper FGCU -- Paper. (We have done a couple of web surveys.) FIU -- Paper FSU -- Paper NCF -- Not created one yet UCF -- Depends on librarian USF Polytechnic -Paper Has anyone had problems implementing a web evaluation? FAMU -- In class FGCU -- In class FIU -- 8-15 days FSU – After class, 1-7 days NCF -- At the end of the semester UCF -- In class USF Polytechnic -- In class When do you think is the best time to administer an evaluation? FAMU -- No FGCU -- May tailor surveys for a class FIU -- No FSU -- No NCF -- Not created one yet – 1st year classes are ver y different from senior seminars. UCF -- No USF Polytechnic -- No Do you get feedback from all of the library instruction sessions taught or do you do just get samples? I get feedback from all the First Year Experience classes, but the rest of the undergraduate classes do not give me feedback. FSU All. USF Polytechnic Most feedback is done verbally by the students or the professor. NCF We get a very good sample usually several for each library instructor, for each grade level and across disciplines. FIU Feedback is received from all of the library instruction sessions FAMU Usually it is just samples. However, we do collect evaluations from certain courses. UCF We do not get feedback from all classes, just samples. FGCU How you have used or plan to use these evaluative tools to improve library instruction? I am presently working on a pre/post test for the FYE classes. We have a librarian who in charge of assessment and our committee is developing tests. I did another version of a pre/post test and did not think it was focused so we are redeveloping another. FSU Adjusted level of details and content USF Polytechnic We have just developed a QEP (Quality Enhancement Program) for 1st year students to improve writing and research skills. There will be some type of assessment at the end of these QEP classes but that assessment is still in the design stage. NCF How you have used or plan to use these evaluative tools to improve library instruction? For FIU, we send all classes a single evaluation form but other types of evaluation are done by individual librarians including minute papers, correcting assignments, pre-post tests, classroom response systems, and bibliography analysis. Librarians use these tools to gain a better understanding of what students learned during the presentation and use comments to help improve their instruction. Most of the tools used are primarily level 1 -- reaction and how did they like the presentation. A few questions may address level 2--learning but not many. FGCU Do you report the findings to administration or your supervisor? Other Comments I think we do not do enough assessment in our classes. I would like to assess every class or at least do a great deal more. Want to create electronic one for faculty requesting the session Seeing other evaluation forms being used at various institutions will be helpful in developing ours. Since we send our evaluations a week or more after the library session, we are impressed to see the overwhelming number of comments we get that specifically address class content. Apparently, they were listening. :) Our library instruction survey for students will be electronically administered using Survey Monkey during the next semester We are continually trying to improve them. We have used various tools to assess instruction classes. While the forms are not very detailed, generally instructors have learned something from each one. I do not think we need to reinvent the wheel with regards to assessment and would like to know about successful tools librarians have used in their classes. Current /Draft Evaluation tools of Florida SULs PLEASE GO TO: PSPC INFORMATION LITERACY SUBCOMMITTEE WIKI HTTP://INFOLITFLORIDA.PBWIKI.COM/