Fall 2012 Reference Desk Transaction Survey Program Student Learning Outcomes Assessed PSLO 1: Students demonstrate information competency and critical thinking skills through their ability to effectively acquire, interpret, critically evaluate and use information for oral and written purposes, with some understanding of its ethical and legal ramifications. PSLO 3: Students build on technology skills by using LLR computers, software programs and electronic media to search for and use information; and to create work required for courses and that advances understanding. PSLO 4: Students learn to obtain and apply information to meet practical needs, such as information for careers/employment, citizenship and GED exams, and English language acquisition. Assessment Tool Brief survey card of 4 multiple-choice questions, with one 2-part question. Number of participants 114 at 6 library locations Description Over a one-week period in Fall 2012, reference desks at all seven library locations (at six different college centers) distributed a brief survey form to students after in-person reference transactions. The survey instrument comprised four questions, one of which was two-part. The survey was developed based on the WOREP (Wisconsin-Ohio Reference Evaluation Program) survey to assess the efficacy in achieving LLR’s PSLOs 1, 3 & 4: specifically students’ increased understanding of how to find, evaluate or cite information sources as a result of their reference transaction; improved understanding of using technology and equipment; acquire information or skills useful outside of the educational sphere; and how successful the reference transaction was, that is, did students find what they sought. One-hundred fourteen surveys were completed among all seven library locations. Results A majority of respondents increased their understanding of how to find information (78% of 114 respondents), 24% to cite, and 27% to evaluate information. A further 24% learned skills other than these. Of those responding to the questions, 80% learned technological skills (N=112) and 41% felt they learned skills useful in other areas of their life (N=111). Fewer than 5% of those who responded to the question (N=111) stated that they did not fully find information that fulfilled their need, no one said they found nothing that fulfilled their information need. About 88% of respondents to the questions (N=111) found at least most of what they needed (73% indicated they found exactly what they asked for). 2/9/2016, p.1 of 3 Of students who found what they needed, and those who specified, librarians helped them find the information 69% of the time; about 30% found it by using the librarian's suggestions; only 2% found the information without the help they received from librarians. Recommendations The relatively low number of students who understood more about evaluating resources (compared to skills for finding information) as a result of their reference transaction points to an opportunity to emphasize in more kinds of reference transactions the need to evaluate resources. Future assessments will be conducted over a longer period to allow for more sufficient data for site-specific analysis, and may assess a narrower scope of SLOs to allow for more in-depth examination of the student’s experience in the reference transaction. If resources allow, assessments comparing student and librarian experiences, or measuring student learning, rather than students’ perception of learning, would be very useful. 2/9/2016, p.2 of 3 Fall 2012 Reference Desk Transaction Survey From your interaction with the librarian, you better understand how to … Did you learn new computer/ equipment skills helpful for school? Did you learn skills useful in areas of life outside school? Did you find what you asked for? How the information was found Find info Evaluate source Give credit for sources I use Other None of these (learned something else) Does not apply to my question Results from respondents at 6 library locations over a oneweek period: blank N= 89 78% 31 27% 27 24% 27 24% 0 0% 3 3% 1 1% 113 Yes No Maybe NA blank N= 90 80% 5 4% 4 4% 13 12% 2 2% 112 Yes No Maybe NA blank N= 46 41% 20 18% 15 14% 30 27% 3 3% 111 Yes Mostly Other Not Really No blank N= 81 73% 17 15% 9 8% 4 4% 0 0% 3 3% 111 Libn Help Used Sugg No Help blank N= 73 69% 31 29% 2 2% 8 7% 106 A majority increased their understanding of finding information (78% of 114), 24% to cite, and 27% to evaluate information. A further 24% learned skills other than these. Of those responding to the questions, 80% learned technological skills (N=112) and 41% felt they learned skills useful in other areas of their life (N=111) Fewer than 5% (N=111) did not find all the information needed, and no one was unable to find something useful. About 88% (N=111) found at least most of what they needed (73% found exactly what they asked for). Of students who found what they needed, librarians helped them find it 69% of the time; about 30% found it by using the librarian's suggestions; only 2% found the information without assistance. Location totals Alice Statler: 12; Chinatown/North Beach: 5; Downtown: 10; John Adams: 2; Mission: 14; Rosenberg: 71; Southeast: 0. Total: 114 2/9/2016, p.3 of 3