LIS 770-02 Management of Libraries and Information Centers: Program Assessment Fall 2007 Jon Kirsch December 19, 2007 1 Taylor’s Scientific Management and The LibQual+ Management Tool: A Contrast of Usefulness As managers of libraries strive to meet their responsibilities, many feel the enormity of the challenge. The age of information competition has posed library managers with new dilemmas on maintaining the library’s relevancy. If the challenge has become greater, however, so too have the tools at the library manager’s disposal. This progress becomes clear when contrasting obsolete management theory from the beginning of the 20th century with the latest resource for library managers in the 21st century. Frederick Taylor’s groundbreaking scientific management was designed to “secure the maximum prosperity for the employer, coupled with the maximum prosperity for each employee” using systematic, scientific methodology (Taylor, 1911, p. 1). Yet his management theory failed to be useful for libraries because of its focus on the employer rather than the user and its ignorance of human psychology. In contrast, academic libraries since 2000 have developed a management tool called LibQual+™ (LibQual). This innovative tool for library self-assessment is effective in two important ways. LibQual cultivates a more service-oriented culture in libraries and gives libraries effective measures to make specific improvements to their organization. Although LibQual can be utilized in any library, it was designed for academic libraries and the following analysis will focus on that library context. Frederick Taylor is known as the management pioneer who believed in a “one best way” for tasks (Rainey, 2003, p. 25). More specifically, Taylor used time-motion studies and argued for a concept of analyzing the time involved with every little task to increase work efficiency (Hough & White, 2001, p. 586). Taylor believed in centralized planning and elaborate regulations to rigidly keep employees efficient (Provenmodels, 2 2007). In essence, Taylor felt that management and workers should complement each other and that each could benefit from increasing efficiency. Unfortunately Taylor’s more scientific methodologies were poorly adapted for the library service environment. In the library context the user is often paramount, not the employer. Taylor’s industrial or factory context did not lend itself well to an age where “only customers judge quality; all other judgments are essentially irrelevant” (Saunders, 2007, p. 22). Library service is not a concrete, physical commodity like steel or pig iron, and therefore Taylor’s methods were too simplistic to be useful. It was not just a matter of library directors testing the librarian’s every minute task in budgeting time to help patrons. Aspects of service quality collided with service efficiency to muddy the waters of simple production assessment. Additionally, Taylor’s philosophy failed to understand the psychological motives of employees, particularly in the library world. Taylor assumed that workers cared more about financial reward than their work. Yet many library volunteers are motivated purely by job satisfaction, and the library profession generally attracts those concerned with helping the public. Taylor also made the psychological miscalculation of believing in a rigid separation between planning and execution, however most libraries have discovered that continuous learning amidst changing information technology necessarily blurs that distinction. For such continuous learning, allowing employees to take initiative becomes much more valuable than Taylor realized. Therefore if Taylor’s ground-breaking early 20th century wisdom cannot be applied to libraries, how can libraries improve the way they manage? Better selfassessment has become crucial to managing. At the forefront of library self-assessment 3 and particularly academic library self-assessment is a survey tool called LibQual. LibQual evolved as researchers realized that the old forms of self-assessment for libraries were inadequate. For many years businesses and libraries used questions with simple Likert scales such as user satisfaction of a particular service on a scale of 1 to 5 (Saunders, 2007, p. 22). Many libraries chose to use input variables such as collection or serial counts, but these measures became less relevant as digital content proliferated (Thompson, 2007). Then, in the 1990s, three professors, Parasuraman, Zeithaml, and Berry, proposed the idea of a more sophisticated survey so that libraries could create a true scale of measurement to evaluate their service. They called their self-assessment survey ServQual, which operated on the idea that “the true measure of satisfaction is the difference between the level of services received and the level expected” (Saunders, 2007, p. 22). This innovation came to be known as gap analysis (Saunders, 2007, p. 22)). LibQual expounded further on this concept by comparing patrons’ minimum expectations, desired expectation, and perception of the service itself. LibQual was developed by the Association of Research Libraries (ARL) in cooperation with faculty members at Texas A & M University. They wanted to formulate a survey that enabled libraries to discover their strengths and weaknesses while also comparing performance with other libraries. LibQual evolved into a survey with 22 core items and an open comments box for users to evaluate their library on three criteria. Each of the 22 items measured three dimensions: (1) Quality of service provided by the staff, (2) Extent and quality of information resources provided by the library, including the ease 4 of access to information, and (3) Quality of the physical space provided by the library (University of Texas, 2007). The first major advantage of LibQUAL is that it cultivates a service-oriented culture among libraries. One of the great virtues of the survey is that it “transcends a local campus survey” (Sanville, 2004, p. 13). Previously, many libraries had tools of selfassessment that were valuable. However, because each library had its own idiosyncratic methods for evaluating its services, it was extremely difficult to meaningfully compare one library to another. The blanket adoption of LibQual by many libraries and consortia has now created a meaningful tool for such comparison. As the Healey Library of the University of Massachusetts noted approvingly, the LibQual survey was vital because it allowed them to “benchmark UMass Boston results against those of other colleges and universities to determine best practices” (Healey Library, 2007). Having a systematic empirical survey like LibQual provided many libraries with a fresh impetus for competitiveness more reminiscent of the business sector than non-profits. In fact, libraries were so eager to measure themselves against their peers that administrators of LibQual urged participating libraries not to discuss head-to-head comparisons with other libraries (Hubbard & Walter, 2005, pp. 39-40). LibQual also makes academic libraries more service-oriented by increasing their value to the larger institution. As one college library noted, “Because the college has an ongoing assessment program, we received institutional support in 2003 to participate in the LibQual+ survey” (Sanders & Varnet, 2005, p. 463). With colleges concerned about maintaining their accreditation, LibQual has highlighted the importance of the library as a component in the university’s total self-assessment. Instead of the library’s self- 5 assessment being truncated as a minuscule portion of a larger, overshadowing universitywide assessment, LibQual has given the library distinctive status. For instance, some academic libraries have utilized the Noel-Levitz SSI for self-assessment. While useful, the survey has only two library-related questions: “Library staff are helpful and approachable?” and “Library resources and services are adequate?” (Sanders & Varnet, 2005, p. 463). By providing many and more in-depth questions, LibQual sets the ground for more in-depth analysis and therefore increases the likelihood that an institution will perceive the library’s independent role at the university. In other practical ways LibQual encourages academic libraries to become serviceoriented because the data is highly detailed and readily interpretable. One library that participated in the LibQual survey found that “the information derived from it was much more detailed than that obtained from earlier General Satisfaction surveys or the University-wide surveys conducted by the Assessment Office” (Hubbard & Walter, 2005, p. 41). The ARL gives each participating library useful data and a powerful tool to continue its own analysis: ARL gives the participating library a document containing charts and summary data. An SPSS file of raw data also is made available for further analysis…we used the raw data to create many additional charts and data subsets. By this means…we were able to do data sets and charts for each college at the university and for certain subsets of the faculty and students. By drilling down into the data, we discovered patterns of responses that were not apparent from the aggregated data (Saunders, 2007, pp. 22-23). These methods allow libraries to effectively evaluate whether their collections are meeting one department’s needs while neglecting another discipline. The University of Pittsburgh Library discovered, for example, that it had ignored the needs of its graduate 6 student patrons because the electronic journal collection was not extensive enough to meet research needs (Saunders, 2007, p. 23). Furthermore LibQual has concrete value in its ability to provide measures that allow organizations to make specific improvements. For example, one component of LibQual consists of an open-ended comment section. One study noted that, “consistently, across libraries, a striking percentage of participants – roughly 40% -- provide comments, which flesh out users’ service quality perceptions, and make specific recommendations for service quality improvements” (Thompson, 2007). A recent case study illustrated the importance of these user comments. Out of 211 participants, 70 respondents at Pittsburgh University Library provided detailed written comments (Hubbard & Walter, 2005, p. 39). Comments confirmed what the results in the data had already shown. The 22 short questions had highlighted three major problems at the library. The library lacked a comfortable and inviting location, modern equipment that lets one easily access needed information, and information made easily accessible for independent use. By using comments that correlated positively with the questions, the library was able to pinpoint specific weaknesses. In trying to solve the lack of an inviting or comfortable location, librarians realized that the interior furnishings of the library were more than three decades old. Following the LibQual survey a major interior renovation consisted of painting, fresh carpeting, new elevators, and comprehensive reupholstering of old seating. To improve modern equipment the library sped up web access by switching to a better local area network and internet provider. Lastly, to improve making information accessible for independent use the library improved its EZ Proxy server and 7 software and allowed students to use library databases more easily off-campus (Hubbard & Walter, 2005, pp. 41-42). The Pittsburgh University Library responded to undergraduates’ dissatisfaction in the LibQual survey also. Undergraduates’ lack of library usage was related to the no food-and-drink policy. The library not only changed these policies, allowing food and bottled drinks in specified areas. The library even added its own coffee bar (Saunders, 2007, pp. 22-23). The LibQual survey also revealed that students preferred receiving help from peers rather than librarians as a first resort. Consequently, the Pittsburgh University Library established a system of student consultants to help answer preliminary queries (Saunders, 2007, p. 23). Another library found that the “library as a place” component of the LibQual survey scored disastrously. Similarly to the Pittsburgh scenario, they responded with a long-term renovation process in the summer of 2003 and since then have produced data showing that attendance at the library has increased (Sanders & Varnet, 2005, pp. 464-465). Even if the LibQual survey does not prescribe what specific action should be taken, the survey offers libraries with a specific area to focus efforts for improvement. For instance, in many libraries the “affect of service” component of the LibQual survey had the highest impact on user satisfaction according to empirical analysis. As the analyst noted, “The AS (Affect of Service) dimension is the dominant indicator for each equation. This result highlights the importance that the people working for the library operation have on user satisfaction with the service delivered by the academic library” (Heinrichs, Lim & Sharkey, 2005, pp. 264-265). These kinds of results can lead library managers to at least focus on training programs or restructuring staff. Even if LibQual 8 cannot say how to change a service, knowing which part of service requires improvement is the first crucial step. In a similar scenario, Pace University Library, which has multiple facilities, found that the LibQual survey specifically pointed out which facilities were under-utilized and revealed problems in the university’s cell phone policy (McGuire, 2003). Therefore, even if libraries may not know specifically how to solve a problem identified by LibQual, at least the library knows where it must begin. Nonetheless, despite LibQual’s ability to engender a culture of service and help libraries identify specific weaknesses in service, it is not without limitations. LibQual is a web-based survey, and this method produces a research bias. Web-based surveys require computer literacy and access to hardware and software. Computer-illiterate, nontraditional students may be underrepresented. LibQual’s web-centered interface may also neglect input from groups of limited financial means who do not own computers such as racial and ethnic minorities (Perkins, 2004, p. 123). Furthermore, LibQual requires staff time and on-staff expertise. Staff must be interested and engaged in learning how to use LibQual as a tool (Sanders & Varnet, 2005, p. 461). The $2,000 cost for a library to do the LibQual survey may be prohibitive for smaller university libraries unless they can get funding support from the larger institution (Hubbard & Walter, 2005, p. 36). Additionally LibQual identifies specific weaknesses but cannot offer comprehensive solutions. Recognizing a lack of library service and using that information to systematically develop a strategic plan is difficult (Saunders, 2007, p. 23). Meanwhile other librarians have shown concern about the user-centric nature of LibQual. One expert commented that LibQual in its research design states, “It might be desirable from a practical point of view if a reasonable characterizations of user perceptions summarized 9 user views in a single score” (Edgar, 2006, p. 12). The problem with this perspective is that it indicates that library service effectiveness can be gauged by a single constituency. LibQual may not effectively measure the needs or values of funding stakeholders (Edgar, 2006, pp. 12-13). While funding stakeholders certainly value user satisfaction, they may have their own distinct desires and expectations. Frederick Taylor’s once revolutionary scientific management lacked practical applications for libraries. Ultimately, however, libraries and particularly academic libraries are discovering new management tools. Primary among those tools is LibQual. This survey instills a service-oriented outlook while giving libraries increased accuracy to identify and take action against specific service deficiencies. LibQual is not the last word in self-assessment; however it does represent a groundbreaking development. LibQual predicts a world where libraries can monitor performance in a standardized, credible assessment scheme. Using tools such as LibQual libraries can better market themselves to key stakeholders and justify the services they offer or the changes they want to make happen. Library managers can therefore do more than just manage their library. They can better manage the external threats their libraries are facing. 10 Works Cited: Edgar, W. B. (2006, October). Questioning LibQUAL+(™): Expanding its assessment of academic library effectiveness. Portal: Libraries & the Academy, 6(4), 445-465. Healey Library. (2007). Take the survey!!. Retrieved December 11, 2007, from http://www.lib.umb.edu/libqual Heinrichs, J. H., Lim, J., & Sharkey, T. (2005, May). Relative influence of the LibQUAL+(™): Dimensions on satisfaction: A subgroup analysis. College & Research Libraries, 66(3), 248-265. Hough, J. R., White, M. A. (2001). Using stories to create change: The object lesson of Frederick Taylor’s “pig-tale”. Journal of Management, 27(5), 585-601. Hubbard, W. J., & Walter, D. E. (2005, Spring). Assessing library services with LibQUAL+: A case study. The Southeastern Librarian, 53(1), 35-45. McGuire, N. (2003). LibQUAL+ service quality survey: The results are in. Retrieved December 14, 2007, from http://www.pace.edu/library/pages/newsletter/fall2003/libqual.html Perkins, G. H. (2004, September). Will libraries’ web-based survey methods replace existing non-electronic survey metehods?. Information Technology & Libraries, 23(3), 123-126. Provenmodels. (2007). Scientific management. Retrieved December 15, 2007, from http://www.provenmodels.com/29/scientific-management/taylor Rainey, H. G. (2003). Understanding & managing public organizations (3rd ed.). San Francisco: Jossey-Bass. Sanders, M. R., & Varnet, H. (2005, June). Asking better questions: Small-scale assessment measures that inform ongoing work. College & Research Libraries News, 66(6), 461-465. Sanville, T. (2004). Defending and expanding library turf: The need for scalable consumer research. Journal of Library Administration, 40(3), 13-17. Saunders, S. E. (2007, Fall). The LibQUAL+ phenomenon: Who judges quality?. Reference & User Services Quarterly, 47(1), 21-24. Taylor, F. W. (1911). The principles of scientific management. New York: Harper & Row. 11 Thompson, B. (2007). The origins/birth of LibQUAL+(R). Retrieved December 9, 2007, from http://www.coe.tamu.edu~bthompson/libbirth.htm University of Texas. (2007). What is LibQUAL+?. Retrieved December 11, 2007, from http://www.lib.utexas.edu/vprovost/assessment/libqual/index.html 12