Primo Usability Evaluation

advertisement
Primo Usability Evaluation
Cody Hanson, Technology Librarian
University of Minnesota Libraries
codyhanson@umn.edu
Primo Usability Evaluation
Primo
Usability testing
Scenarios
Issues
Outcomes
Primo
• Primo
• Usability testing
• Scenarios
• Issues
• Outcomes
Primo
• Primo
• Usability testing
• Scenarios
• Issues
• Outcomes
Primo
• Primo
• Usability testing
• Scenarios
• Issues
• Outcomes
Primo
• Primo
• Usability testing
• Scenarios
• Issues
• Outcomes
Primo
• Primo
• Usability testing
• Scenarios
• Issues
• Outcomes
Primo
• Primo
• Usability testing
• Scenarios
• Issues
• Outcomes
Primo
• Primo
• Usability testing
• Scenarios
• Issues
• Outcomes
Primo
• Primo
• Usability testing
• Scenarios
• Issues
• Outcomes
Primo
• Primo
• Usability testing
• Scenarios
• Issues
• Outcomes
Primo
• Primo
• Usability testing
• Scenarios
• Issues
• Outcomes
Primo
• Primo
• Usability testing
• Scenarios
• Issues
• Outcomes
Primo
• Primo
• Usability testing
• Scenarios
• Issues
• Outcomes
Primo
• Primo
• Usability testing
• Scenarios
• Issues
• Outcomes
Development Partnership
Aleph/Primo pipe
Cost of ownership assessment
Usability testing
OIT Usability Lab
OIT Usability Lab
Eye tracking
Eye tracking
Eye tracking
Staff roles
Usability Testing
Roles
Narrator
Logger
Helpdesk
Eye-tracker observer
Usability Testing
Scenarios and tasks
Debriefing
Qualitative
Key deliverables:
Issues list
Eye-tracking data
Key deliverable
http://www.flickr.com/photos/stofiska/3021577770/
http://www.flickr.com/photos/setr/3330196387/
Key deliverable
http://www.flickr.com/photos/joelogon/2098848889/
Key deliverable
Goals
Users can find a variety of library
materials on their topic
Users can find a particular item, its
availability, or its call number
Users understand the process of
broadening and narrowing searches
Goals
Determine whether current MNCAT
users see Primo as an improvement
Determine if Amazon.com users can
easily transfer their knowledge to use
Primo
Scenarios
You are taking an intro
course in marketing.
Find some articles on marketing and
advertising
Determine whether there are more
results for your query and how you
could see them
Find some books about
Minneapolis.
Save two or three of the books you find
for future reference.
Make sure these items are saved so
you can come back to them next week.
You’d like to read Edmund
Hillary’s High Adventure.
Find the book.
Add a tag to the record for this book that
would help describe it.
Your classmate wrote a
review for [insert book
here].
Find the book.
Find the review and say out loud what
rating your classmate gave the book.
Add your own review and rating.
Find this article using this
citation.
Find the online version of the article and
read the first paragraph.
Issues
Search box tabs not
used/seen
“Several evaluators did not use or see
the... tabs above the search box. When
the tabs were not used, it lead to
searching that was less likely to find the
desired results.”
Search box tabs not
used/seen
Search box tabs not
used/seen
“Several evaluators did not use or see
the... tabs above the search box. When
the tabs were not used, it lead to
searching that was less likely to find the
desired results.”
Advanced searches
unsuccessful
“Use of the Advanced Search was
unsuccessful for some of the evaluators...
One evaluator expressed confusion about
why the narrow search wouldn’t find the
result, but the basic search would.”
Unclear when newly tagged
items will appear
“Evaluators expected that their tagged
items would appear in the list of ‘all
tagged results’ immediately...”
Article search progress bar
caused
confusion/frustration
“This wait caused some evaluators to
consider stopping the search or changing
their search terms to get a search to
complete faster.”
http://www.flickr.com/photos/28445735@N00/2397240784/
Key deliverable
Positive comments
“Several evaluators said that they liked
the tabs and new design.”
“Some of the evaluators mentioned that
they thought the tabs ‘presented
everything you need.’”
“Some evaluators said that Primo is
‘easy to use.’”
Desirability
Desirability
90% positive
6 of 8 evaluators chose “Organized”
5 of 8 chose “Clean”
5 of 8 chose “Straightforward”
Notes
from our
users...
http://www.flickr.com/photos/cutsie/3614949532/
http://www.flickr.com/photos/cutsie/3614949532/
http://www.flickr.com/photos/cutsie/3614949532/
http://www.flickr.com/photos/cutsie/3614949532/
http://www.flickr.com/photos/cutsie/3614949532/
http://www.flickr.com/photos/cutsie/3614949532/
http://www.flickr.com/photos/cutsie/3614949532/
Fast
Straightforward
Clean
Organized
Fast
Easy
Improved
Straightforward
Modern
Familiar
Clean
Fast
Organized
Familiar
Organized
Organized
Consistent
Efficient
Clean
Helpful
Sophisticated
Clean Straightforward
Straightforward
Trustworthy
Efficient
Helpful
Powerful Easy
Improved
Organized
Straightforward Clean
Organized
Attractive
Desirability
Goals
Users can find a variety of library
materials on their topic
Users can find a particular item, its
availability, or its call number
Users understand the process of
broadening and narrowing searches
Goals
Determine whether current MNCAT
users see Primo as an improvement
Determine if Amazon.com users can
easily transfer their knowledge to use
Primo
Outcomes
Context
Confidence
Clear action items for vendor
Better relationship with vendor
Primo Usability Evaluation
Cody Hanson, Technology Librarian
University of Minnesota Libraries
codyhanson@umn.edu
Download