Primo Usability Evaluation Cody Hanson, Technology Librarian University of Minnesota Libraries codyhanson@umn.edu Primo Usability Evaluation Primo Usability testing Scenarios Issues Outcomes Primo • Primo • Usability testing • Scenarios • Issues • Outcomes Primo • Primo • Usability testing • Scenarios • Issues • Outcomes Primo • Primo • Usability testing • Scenarios • Issues • Outcomes Primo • Primo • Usability testing • Scenarios • Issues • Outcomes Primo • Primo • Usability testing • Scenarios • Issues • Outcomes Primo • Primo • Usability testing • Scenarios • Issues • Outcomes Primo • Primo • Usability testing • Scenarios • Issues • Outcomes Primo • Primo • Usability testing • Scenarios • Issues • Outcomes Primo • Primo • Usability testing • Scenarios • Issues • Outcomes Primo • Primo • Usability testing • Scenarios • Issues • Outcomes Primo • Primo • Usability testing • Scenarios • Issues • Outcomes Primo • Primo • Usability testing • Scenarios • Issues • Outcomes Primo • Primo • Usability testing • Scenarios • Issues • Outcomes Development Partnership Aleph/Primo pipe Cost of ownership assessment Usability testing OIT Usability Lab OIT Usability Lab Eye tracking Eye tracking Eye tracking Staff roles Usability Testing Roles Narrator Logger Helpdesk Eye-tracker observer Usability Testing Scenarios and tasks Debriefing Qualitative Key deliverables: Issues list Eye-tracking data Key deliverable http://www.flickr.com/photos/stofiska/3021577770/ http://www.flickr.com/photos/setr/3330196387/ Key deliverable http://www.flickr.com/photos/joelogon/2098848889/ Key deliverable Goals Users can find a variety of library materials on their topic Users can find a particular item, its availability, or its call number Users understand the process of broadening and narrowing searches Goals Determine whether current MNCAT users see Primo as an improvement Determine if Amazon.com users can easily transfer their knowledge to use Primo Scenarios You are taking an intro course in marketing. Find some articles on marketing and advertising Determine whether there are more results for your query and how you could see them Find some books about Minneapolis. Save two or three of the books you find for future reference. Make sure these items are saved so you can come back to them next week. You’d like to read Edmund Hillary’s High Adventure. Find the book. Add a tag to the record for this book that would help describe it. Your classmate wrote a review for [insert book here]. Find the book. Find the review and say out loud what rating your classmate gave the book. Add your own review and rating. Find this article using this citation. Find the online version of the article and read the first paragraph. Issues Search box tabs not used/seen “Several evaluators did not use or see the... tabs above the search box. When the tabs were not used, it lead to searching that was less likely to find the desired results.” Search box tabs not used/seen Search box tabs not used/seen “Several evaluators did not use or see the... tabs above the search box. When the tabs were not used, it lead to searching that was less likely to find the desired results.” Advanced searches unsuccessful “Use of the Advanced Search was unsuccessful for some of the evaluators... One evaluator expressed confusion about why the narrow search wouldn’t find the result, but the basic search would.” Unclear when newly tagged items will appear “Evaluators expected that their tagged items would appear in the list of ‘all tagged results’ immediately...” Article search progress bar caused confusion/frustration “This wait caused some evaluators to consider stopping the search or changing their search terms to get a search to complete faster.” http://www.flickr.com/photos/28445735@N00/2397240784/ Key deliverable Positive comments “Several evaluators said that they liked the tabs and new design.” “Some of the evaluators mentioned that they thought the tabs ‘presented everything you need.’” “Some evaluators said that Primo is ‘easy to use.’” Desirability Desirability 90% positive 6 of 8 evaluators chose “Organized” 5 of 8 chose “Clean” 5 of 8 chose “Straightforward” Notes from our users... http://www.flickr.com/photos/cutsie/3614949532/ http://www.flickr.com/photos/cutsie/3614949532/ http://www.flickr.com/photos/cutsie/3614949532/ http://www.flickr.com/photos/cutsie/3614949532/ http://www.flickr.com/photos/cutsie/3614949532/ http://www.flickr.com/photos/cutsie/3614949532/ http://www.flickr.com/photos/cutsie/3614949532/ Fast Straightforward Clean Organized Fast Easy Improved Straightforward Modern Familiar Clean Fast Organized Familiar Organized Organized Consistent Efficient Clean Helpful Sophisticated Clean Straightforward Straightforward Trustworthy Efficient Helpful Powerful Easy Improved Organized Straightforward Clean Organized Attractive Desirability Goals Users can find a variety of library materials on their topic Users can find a particular item, its availability, or its call number Users understand the process of broadening and narrowing searches Goals Determine whether current MNCAT users see Primo as an improvement Determine if Amazon.com users can easily transfer their knowledge to use Primo Outcomes Context Confidence Clear action items for vendor Better relationship with vendor Primo Usability Evaluation Cody Hanson, Technology Librarian University of Minnesota Libraries codyhanson@umn.edu