Katelyn Buote
MACKsearch: Implementing EBSCO Discovery Service (EDS)
at Merrimack College’s McQuade Library
Special Project Proposal
Katelyn Buote
Southern Connecticut State University
Research in Information and Library Science
Dr. Mary Brown
ILS 580
Summer 2014
July 25, 2014
buotek1@owls.southernct.edu
1
Katelyn Buote
Introduction and Overview
Discovery tools are quickly making their way into academic libraries across the nation.
The popularity of discovery tools is linked to social networks and features they have that
traditional catalogs don’t have. Thus, discovery tools make the traditional catalog more like a
social catalog. Most current discovery tools operate similar to Google. Like Google, discovery
tools pull information from all available sources, provide search capabilities, including searching
full text, and then provide direct access to the full documents if they are available (Alderman,
2012).
The McQuade Library, located in Merrimack College in North Andover Ma., will be
implementing MACKsearch, an EBSCO Discovery Service (EDS) at Merrimack College in
either the fall of 2014 or spring of 2015. Previously, the McQuade Library has relied upon the
traditional cataloging system and online databases. The transition to the new EDS means that the
print collection and online articles will merge into one, where students and patrons will be able
to assess both the print and virtual collections at the same time. Additional features include
spellcheck, RSS feeds, email alerts, bookmarking tagging, community reviews, and other 2.0
features. Librarians at McQuade have expressed concern about the implementation of this new
tool and some have found EDS to be confusing and have an un-academic feel. Librarians are also
left to wonder about the usefulness of these tools to library patrons. Will students use it? Will
they like it? Do they find it confusing?
To address these very questions, this study will evaluate patrons’ perceptions of the new
tool (MACKsearch) and assess their reactions to it by conducting a voluntary survey.
2
Katelyn Buote
Significance and Relevance
The Library and Information Science (LIS) field has conducted a number of studies on
the function of discovery tools. However, there has not been a sufficient amount of research
conducted on user satisfaction of these new discovery tools. In order to understand the full
impact of discovery tools it is necessary to also investigate their emotive side through user
satisfaction studies. By looking at the user’s feelings about the implementation of EBSCO
Discovery Service (EDS) in a specific academic library we will gain additional knowledge of
discovery tools that will add to the LIS field’s understanding of this software.
On a local level, the results of this proposed research will provide the librarians at
McQuade Library with essential information regarding the impact of MACKsearch on its
patrons. A significant problem with the implementation of these new tools is that librarians are
left to wonder how students and other patrons will react to the new discovery tool. This study
will provide the librarians at McQuade with useful information needed to more effectively
instruct patrons on how to use the discovery tool, and ultimately to make their decision on
whether to keep EBSCO Discovery Service (EDS). These findings could also benefit other
academic libraries as they plan to implement these services.
Literature Review
Historically, library catalogs and online databases have been two distinct tools upon
which researchers and librarians have relied upon. A new trend, however, is emerging in which
these two formats merge into one discovery tool. With various features that are considered
3
Katelyn Buote
“google-like”, these discovery tools are growing in popularity that “provides a single point of
access to a range of library resources that enable users to search multiple resources with a single
search” (Allison, 2012, p. 2). Some common examples of discovery tools are EBSCO Discovery
Service, Summon service (Serial Solutions), AquaBrowser Library (Serial Solutions), Encore
Discovery (Innovative Interfaces, Primo Central (Ex Libris Group), and Blacklight (open source
University of Virginia).
Allison (2012) considered why a library would want to implement a discovery tool. The
result was the following eight key reasons.
Libraries implement discovery tools to:
-
Simplify the research process with a single search.
Market locally created databases to their community to increase visibility and use.
Provide a more intuitive search interface that encourages discovery and do away with
complex searching that confuses users.
Improve the “depth” of metadata to index content not included in their catalog
Integrate Web 2.0 options with their search engine (tagging, reviews, etc.). Give your
searchers a reason to return to their site.
Enhance remote access to their library
Make searches successful
Promote the library as a quality research source that meets the changing expectations of
our users.
Allison (2012) also summarizes what to expect when using a discovery tool. This list
includes features like one place to search, search catalog, article databases, and locally created
databases; real time information; support for search strategies; minimize key strokes; support
bookmarking, tagging, community reviews, and other Web 2.0 features; social networking
capabilities, and advanced search capabilities.
EBSCO Discovery Service (EDS) is just one example of a discovery tool. “EBSCO
Discovery Service brings together the most comprehensive collection of content- including
4
Katelyn Buote
superior indexing from top subject indexes, high-end full text and the entire library collection- all
within an unparalleled full-featured, customizable discovery layer experience” (EBSCO, 2014).
In her research, Allison (2012) goes into detail describing the features of EBSCO
Discovery Service (EDS). She states that these features include the following.
EBSCO Discovery Service (EDS) features:
-
Databases from EBSCOhost, (customer subscribed)
Databases from non-EBSCOhost databases (customer subscribed)
OPAC loaded directly; includes real-time availability checks and daily updates (and
searched along with all other content)
Support book jacket images, book records, entertainment records, annotations, family
keys, subject headings, demand information, awards, review citations, etc.
Institutional archives/repositories directly loaded
Facet options including subject, source, publication
Includes alerts
Includes RSS options
Image Quick View
Supports a variety of “widgets” and export portions of EBSCOhost functionality onto
library websites.
EBSCO (2014) adds to this list by claiming that EBSCO Discovery Service (EDS)
features include a true academic research experience; a fast, single search of the collection;
comprehensive content; highly-refined relevancy ranking; elaborate indexing (subject headings,
etc.); the inclusion of high-end indexes; enhanced catalog treatment and handling of repositories;
a full-featured discovery layer user experience; instant access to full text (whenever available); a
truly customized discovery tool; and streamlined/efficient administration.
There have been a number of studies on discovery tools; however, few exist on user
satisfaction of these new services. By reviewing the literature, I have found (only) two particular
studies that assess user satisfaction of discovery tools.
5
Katelyn Buote
First, in the fall of 2011, the Gorge C. Gordon Library at WPI (Worcester Polytechnic
Institute) implemented the discovery tool system called Summon. Soon after installation, a
survey and user study was conducted. Those 240 who participated included 72% undergraduates,
11% graduate students, 7% staff/administration, and 5% faculty. In summary, despite some
frustrations, the discover tool was generally accepted and well-received by all of the major user
groups at WPI. Survey respondents expressed that while Summon is not perfect; it is a good
research tool which leads users to relevant sources on most topics. “It is an improvement on its
predecessor” (Drew, 2012). The study concluded that people are in fact using the tool, where an
average of 200 searches is performed each day, and on some days that number reaches to 800.
The study concludes with a note reminding users that while Summons is a starting place for
research, it cannot replace the highly specialized electronic resources and databases (Drew,
2012).
A second study on user satisfaction with the discovery service Summon was conducted at
Ryerson University, located in Toronto, Canada. The study utilized online questionnaires and inperson focus groups. Overall, results indicated a high level of satisfaction with the discovery
service, although this was heavily influenced by the quality of search results over ease and use.
Satisfaction ratings suggested that undergraduate and graduate student were very or moderately
satisfied. Graduates (4.62%) were more dissatisfied with Summon than undergraduate students
(2.2%). This may be a result of a preference for subject-specific databases, rather than a general
search tool like Summon (Lundrigan, Manuel, & Yan, 2013).
Another study on the usability of discovery tools was conducted at James Madison
University, located in Harrisonburg, VA. This study ran a usability test on eight students and two
faculty members. The test consisted of nine task focused on common patron requests or related
6
Katelyn Buote
to the utility of specific discovery tool features. Software recorded participants’ actions and time
on task, human observers judged the success of each task, and a post-survey questionnaire
gathered qualitative feedback and comments from participants. The study concluded that
participants were successful at most tasks, but specific usability problems suggested some
interface changes for both EBSCO Discovery Service and JMU’s customizations of the tool
(Fagan, Mandernach, Nelson, Paulo, & Saunders, 2012).
The McQuade Library at Merrimack College will be implementing MACKsearch, an
EBSCO Discovery Service (EDS), in either the fall of 2014 or spring of 2015. This study will
evaluate user satisfaction of the newly implemented discovery tool. The review of the literature
will help us apply what we have learned to this study. The literature leads us to believe that
discovery tools are quickly emerging in libraries and becoming popular with researchers. While
not perfect, discovery tools have a wide variety of features that researchers find appealing. The
literature revealed that the most common complaint was that there is currently no available
discovery tool that covers all searchable library systems. Therefore, discovery tools are not a
replacement for highly specialized electronic resources or subject specific databases. However,
further development of discovery tools might see more inclusive searches in the near future.
Methodology
Subjects
Intended participants of this study will be students, staff and administration, and faculty
of Merrimack College (MA) who use Merrimack’s McQuade Library. Since the McQuade
Library is also open to the public, this survey may also include outside patrons. Invitations to
7
Katelyn Buote
participate in the survey will be extended to the entire Merrimack College community.
Participants will be self-selected on a voluntary basis.
Instruments
A survey questionnaire will be used to solicit users’ impressions of and satisfaction with
the newly implemented discovery tool. The questionnaire will include questions about
intuitiveness of the interface design, ease of using the interface, satisfaction with the interface
itself as well as the results of the search, comparison with the previous interface/tools, and
demographic information. The questionnaire will be offered in two forms, electronic and print.
The electronic form will be available on the Library’s website or at http://tinyurl.com/po334ad.
The print form will be available at the Library’s Help Desk on the Library’s first floor.
Procedure
During the fall of 2014 or spring of 2015, flyers will be hung announcing the study and
inviting participation. Participants will be asked to complete this anonymous survey, that will
then provide only general information of their status at Merrimack College, such as year
(Freshman, Sophomore, Junior, Senior), type of user (student, staff and administration, faculty,
or public patron), and majors or areas of teaching. The invitation will explain that the
questionnaire is available at the Library’s Help Desk as well as on the Library’s website.
The questionnaire available on the Library’s website will be hosted through GoogleDocs
and interactive so that participants may complete and submit their responses from a computer in
the library or in the comfort of their home, dorm room, or other location. The link to the
questionnaire will be included within an announcement of the survey and its purpose.
8
Katelyn Buote
The questionnaire available at the Help Desk will include a sign announcing the survey
and its purpose, a stack of questionnaires, a container of sharpened pencils, and a sealed
collection box for completed questionnaires. Both locations will be active for two weeks. The
flyers, inviting participation, will be posted immediately after both locations are ready to receive
participants.
After the two week period is complete and surveys are collected, the data will be
analyzed using graphs and charts and an executive summary will be drafted, which will be
posted on the McQuade Library’s website.
Results
In this study, I hope to achieve a better understanding of user’s experiences and reactions
to MACKsearch, the EBSCO Discovery Service (EDS) at the McQuade Library at Merrimack
College. These finding will impact the McQuade Library in that it will give the librarians
valuable information regarding how McQuade users interact with the EBSCO service. Thus, this
will help the librarians provide better service to the Merrimack population by giving them
information on how they can more efficiently instruct patrons when using the discovery tool.
This information will help the librarians design more direct, effective, and efficient instruction
options for patrons about using the discovery tool.
Conclusions
Discovery tools bring together the virtual library catalog and databases. Some predict that
discovery tools may be the future of the catalog and others claim that discovery tools make the
print collection more discoverable. The library, therefore, strives for patrons to have positive user
9
Katelyn Buote
experiences and be accepting of the new discovery service, thereby using the discovery tool
frequently to locate needed resources. Therefore, a pilot study that allows librarians to gauge user
reaction and use will also permit librarians to design promotional and instructional materials to
ease users through identified problems, thereby facilitating a more positive experience for all
users.
References
Alderman, J. (2012). Discovery tool. Retrieved from
http://www.unf.edu/~alderman/BLISS/discovery.html
Allison, D. A. (2012, January). Discovery tools. Retrieved from
http://www.slideshare.net/nebraskaccess/discovery-tools-you-can-compete-with-google
Drew, C. (2012, March). The “ALL” search - are you finding what you need?. Retrieved from
http://wp.wpi.edu/library/2012/03/22/the-all-search-are-you-finding-what-you-need/
EBSCO. (2014). Maximize the value and usefulness of your collection. Retrieved from
http://www.ebscohost.com/discovery
Fagan, J. C., Mandernach, M. A., Nelson, C. S., Paulo, J. R., & Saunders, G. (2012). Usability
test results for a discover tool in an academic library. Information Technology and
Libraries, 31(1), 83-112. doi: 10.6017/ital.v31i1.1855
Lundrigan, C., Manuel, K., & Yan, M. (2013, December). “Pretty Rad”: Explorations in user
satisfaction with a discovery layer at Ryerson University. Retrieved from
http://crl.acrl.org/content/early/2014/01/17/crl13-514.full.pdf
10
Katelyn Buote
Appendix
The McQuade Library
Wants to Hear from You!
We want to know your experience and opinions of the newly
implemented discovery tool called MACKsearch.
The brief questionnaire can be located at the circulation desk on
the first floor of the McQuade Library or on the McQuade
Library Website.
If you have any questions, please contact Katelyn Buote at
buotek@merrimack.edu.
Thank You for Your Participation
11
Katelyn Buote
MACKsearch Survey
Submit Survey Here:
Thank You for Your Participation
12
Katelyn Buote
Cover Letter
Katelyn Buote, MLS Student
Southern Connecticut State University
501 Crescent Street
New Haven, CT 06515
Dear McQuade Library Users,
The McQuade Library is interested in learning about your experiences with the newly
implemented EBSCO Discovery Service (EDS) called MACKsearch. We are asking your help by inviting
you to participate in a brief survey that will help the library to assess how well the library is meeting the
needs of the community and your experience, feelings, and concerns about the new discovery tool.
My name is Katelyn Buote and I am an alumni student at Merrimack College. As part of my
Master of Library Science degree at Southern Connecticut State University, I am conducting research to
understand user satisfaction of the newly implemented EBSCO Discovery Service (EDS) called
MACKsearch at the McQuade Library. I have constructed a questionnaire that can be located on the
McQuade Library website or at http://tinyurl.com/po334ad and also at the Help Desk located on the first
floor of the McQuade Library.
The research study is voluntary and should only take about 10 minutes of your time. You may
skip any questions you prefer not to answer, and you can stop at any time. Your answers will be
anonymous and confidential. Your name and address will not be collected or recorded in any way. The
data collected from this survey will be kept for a period of three years in a secure location and then
destroyed. There are no known or anticipated risks to participation in this study, and there will be no costs
to you for your participation. By filling out this survey, you are indicating your consent for your answers
to be used in this research.
If you choose to participate, please answer the questions on the brief survey. Your survey can be
left in the collection box provided at the same location where you received it or directly submitted if you
chose to take it online.
If you have further questions, you can contact me through email (buotek@merrimack.edu). If you
have any questions regarding your rights as a research participant, you may contact Southern Connecticut
State University’s IRB officer at: (203) 392-5243.
Thank you in advance for your assistance with this project.
Sincerely,
Katelyn Buote
13
Katelyn Buote
Library Survey for McQuade Library Users
Please take a few minutes to complete this short survey about MACKsearch.
Online survey can be found at: http://tinyurl.com/po334ad
1.
2.
3.
4.
5.
Please indicate the type of user that best describes you. (Student, Staff and Administration, Faculty, or
Public Patron) __________________________________________________________________________
If you are a student, please indicate your year at Merrimack College. (Freshman, Sophomore, Junior,
Senior, Graduate Student, Other, or Not Applicable) ____________________________________________
If you are a student or faculty member, please indicate your major(s) or areas of teaching. (If Applicable)
(For example: science and math; creative arts; humanities, social science; professional studies, etc.)
______________________________________________________________________________________
How often do you use the library website? (Almost daily; at least weekly; at least monthly; infrequently)
______________________________________________________________________________________
What are some of the most common things you currently do on the library website? (Check all that apply)
Search the library catalog for books (including audiobooks and eBooks), CDs, and DVDs
Get basic library information (such as the hours of operation)
Reserve books (including audiobooks and eBooks), CDs, and DVDs
Renew a book, DVD, or CD
Use online databases
6.
7.
8.
Other ______________________________________________________________________________
Has a librarian spoken to you about MACKsearch? (Yes, NO, Not
Sure)__________________________________________________________________________________
Have you used MACKsearch? (Yes, No, Not
Sure)__________________________________________________________________________________
How do you feel about MACKsearch?
Strongly Agree
Agree
Neutral
Disagree
Strongly
Disagree
It is easy to use.
I can find materials I am looking
for.
The items I seek are usually in
the top few search results.
The text of headings and labels is
easy to understand.
The page layout is well
organized.
9.
For what information activities would MACKsearch be most helpful?
______________________________________________________________________________________
______________________________________________________________________________________
14
Katelyn Buote
10. For what information activities would MACKsearch be least helpful?
______________________________________________________________________________________
______________________________________________________________________________________
11. What would you say are the major advantages of MACKsearch?
______________________________________________________________________________________
______________________________________________________________________________________
______________________________________________________________________________________
12. What would you say are the major problems with MACKsearch?
______________________________________________________________________________________
______________________________________________________________________________________
______________________________________________________________________________________
13. If you were unable to find an item using MACKsearch, what would your next steps be?
______________________________________________________________________________________
______________________________________________________________________________________
14. Do you have any other comments or suggestions about MACKsearch?
______________________________________________________________________________________
______________________________________________________________________________________
______________________________________________________________________________________
15