Open Source vs. Standard Software – Impacts on Library Infrastructures Prof. Dr.-Ing. Matthias L. Hemmje Faculty for Mathematics and Computer Science, Chair for Multimedia and Internet Applications, University of Hagen and Scientific and Technical Advisor of InConTec GmbH Prague, 10th of May 2010 About the Speaker Prof. Dr.-Ing. Matthias L. Hemmje University of Hagen Faculty of Mathematics and Computer Science Chair for Multimedia and Internet Applications http://www.lgmmia.fernuni-hagen.de • 18 years of experience in IT R&D on national and international level, >100 Publications • Senior Expert Consultant for BMBF, EC, and R&D spin-offs • 15 years at Fraunhofer IPSI, Darmstadt • Former University Professorships at Ludwig-Maximilians-University Munich and University of Duisburg • Areas of Expertise: HCI, Information Systems, Digital Libraries, Multimedia Archives, Long Term Archival, and Digital Preservation Outline Open Source vs. Standard Software - What is the difference? Introduction to Open Source Free and Open Source Initiatives Open Source History and Exmples Potential Benefits, Disadvantages, & Riscs Make or Buy? Selection & Success Criteria An exemplar approach in the Library Domain Concluding Remarks 3 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Open Source vs. Standard Software What is the difference? Standard Software is sold and supported commercially However, Open Source Software can be sold and/or supported commercially, too. Perhaps, the term Proprietary Software is more correct 4 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Definitions of Open Source Software (I) Open source is an approach to the design, development, and distribution of software, offering practical accessibility to a software's source code. 5 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Definitions of Open Source Software (II) Some consider Open Source as one of various possible design approaches, while others consider it a critical strategic element of their operations. [1] [1] http://en.wikipedia.org/wiki/Open_source 6 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 What is the difference? (I) Usually the question of Open Source vs. Standard Software is framed as Linux vs. Microsoft Innovation vs. Security etc. 7 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 What is the difference? (II) However, this is just a simplification from a Marketing Point of view, because … 8 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Free & Open Source Initiatives … … have been there for ages and … have produced various licensing schemes … are responsible for some of the most radical ICT innovations that man kind has seen so far! 9 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Free & Open Source Initiatives … Public domain Shareware, freeware Copyrighted but free to use GNU Public License (GPL) Creative Commons, Open Source Other licensing: BSD, Q License, etc. 10 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Open Source History (I) Very similar to open standards, researchers with access to the Advanced Research Projects Agency Network (ARPANET) used a process called Request for Comments to develop telecommunication network protocols. 11 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Open Source History (II) Characterized by contemporary open source work, this 1960s' collaborative process led to the birth of the Internet in 1969. [1] [1] http://en.wikipedia.org/wiki/Open_source 12 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Open Source History (III) There are earlier instances of open source and free software such as IBM's source releases of its operating systems and other programs in the 1950s, 60s, and the SHARE user group that was formed to facilitate the exchange of software. [2][3] [2] Fisher, Franklin M.; James W. McKie, Richard B. Mancke (1983). IBM and the U.S. Data Processing Industry: An Economic History. Praeger. ISBN 0-03-063059-2. pages 172-179 IBM unbundled (began charging for) software June 23, 1969 [3] Dave Pitts' IBM 7090 support – An example of distrbuted source: Page contains a link to IBM 7090/94 IBSYS source, including COBOL and FORTRAN compilers. 13 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Open Source History (IV) Before the term Open Source became widely adopted, developers and producers used a variety of phrases to describe the concept. 14 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Open Source History (V) The term Open Source gained popularity with the rise of the Internet, which provided access to diverse production models, communication paths, and, last but not least interactive communities. [1] [1] http://en.wikipedia.org/wiki/Open_source 15 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Open Source History (VI) The decision by some people in the free software movement to use the label “open source” came out of a strategy session held at Palo Alto, California, in reaction to Netscape's January 1998 announcement of a source code release for Navigator. [4] [4] a b Tiemann, Michael (September 19, 2006). "History of the OSI". Open Source Initiative. http://www.opensource.org/history. Retrieved on August 23, 2008. 16 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Open Source History (VII) They used the opportunity before the release of Navigator's source code to free themselves of the ideological and confrontational connotations of the term free software. Netscape licensed and released its code as open source under the Netscape Public License and subsequently under the Mozilla Public License. [5] [5] Muffatto, Moreno (2006). Open Source: A Multidisciplinary Approach. Imperial College Press. ISBN 1860946658. 17 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Open Source History (VIII) 18 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Examples in both Categories OpenSource Proprietory Operating Systems Linux Operating Systems MS Windows, XP, Vista ; SUN Solaris Word Processing and Office Applications openOffice Word Processing and Office Applications MS Office, Adobe Framemaker Software Development Eclipse JDK Software Development .net MS Visual Studio Multimedia Content Creation Gimp Multimedia Content Creation Adobe Photoshop Web Page Design Typo 3 Web Page Design MS Frontpage Adobe Flash, Dreamweaver 19 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Potential Benefits of Standard Software Potential Benefits of deploying to standard software in an application solution: Understand and comply with the business & technological models of commercial software engineering in a professional environment Support of standard software / solutions, including services Compliance with industrial standards 20 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Potential Benefits of Open Source Software (I) Availability of source code Source code to understand and learn from Do not have to re-invent the wheel Free as in “freedom” And sometimes: free as in “gratis” 21 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Potential Benefits of Open Source Software (II) Does not depend on vendor Can choose additional support Can fix bugs and adapt to change in requirements as well as technology 22 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Potential Disadvantages and Riscs of Standard Software (I) Dependent upon a single vendor What if … … the vendor disappears from the market? … the vendor charges too much? … bug fixing and enhancements not sufficient? etc. Monopoly? 23 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Potential Disadvantages and Riscs of Standard Software (II) Too much Intellectual Property can be bad for innovation … 24 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Potential Disadvantages and Riscs of Open Source SW (I) If source code is not looked at, there is no need to have Open Source SW There are also bad codes, unqualified persons which use it, etc. 25 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Potential Disadvantages and Riscs of Open Source SW (II) Software quality assurance process is widely not transparent etc. 26 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Make or Buy? (I) Overall Challenges in the Library Domain Cost Pressure New User Demands 1st Source SearchEngines (Google) Outsourcing/ ASP 2 Clicks Web 2.0 Fast Response Productivity independend Colloborative Cooperations Consolidation „Buy instead of Make“ Competition more e-only Personalisation Standardisation Library Dynamic Content Central Catalogue Virt. Catalogue High Volume Information Streams Open Systems Federated Search Digitisation Quality Internet 27 Mobil Open Source? Ranking Information Sharing Open Access Integration „Recommender“ eJournals eBooks eLearning Single sign On Comfortable GUI Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Make or Buy? (II) Decision Making Dimensions Cost Quality Time Ressource Availability Flexibility Service-Strategy 28 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Make or Buy? (III) Generic Enterprize Experiences IT has become a Commodity and is therefore expected to support almost any kind of Enterprize Application like a Service-Center Significant Cost Pressure requires new positioning: Which are Core Competences? Which are Competences that can be supported economically? Investments „only“ in Core Competences Increasing Deployment of Standard Software Implementation of Sourcing-Strategies (ASP, Outsourcing, Cooperations etc.) 29 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Make or Buy? (IV) Open Source – an Alternative for Libraries? Potential Advantages of building on Open Source Potential Disadvantages of building Open Source Software is „free of cost“ Full Deployment Risk W.r.t. Completeness and Robustness of Functional Sourcecode is freely available Features High Flexibility Development-Know How is bound to human resoures Own Requirements can be mapped very detailled to Features Total Cost of Ownership Open Standards High Follow-up Cost for Maintenance of Application Features and Interfaces Independency of Providers Need for own Support Infrastructure Höhere Schulungskosten No secured follow-up development strategy Need for own Development Resources and Strategy „Time to Market“ pressure 30 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Make or Buy? (V) There is now Standard Answer ... ... but a set of questions to be systematically analysed and answered as a decision support: Is IT application developement a Core Competence of the 31 Library? Does the Library win a Strategic Advantage by means of own IT Developements? How big is the Functional Delta to features of Standard Software? Economic Analysis? Total Cost of Ownership (TCO)? Time to Market – How long until Production? How are the chances for follow-up funding of necessary further Evolution of the Solution? Is there a Funding Basis/Community? Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Make or Buy? (VI) Economic Criteria and Planning of TCO Deployment Costs Production Costs Strategic Aspects Human Resource Costs Human Resource Cost Which are Core Competences Consultancy Costs Maintenance/Support What is the Future Service-Offering? Licensing Costs Hardware Costs Integration into a Solution Architecture Migration Costs Training Cost Openness/Standards Training Costs Update Cost Stability/Security Installation Costs Further Development Budgeting Focus Start-up Overhead Costs 32 Usability Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Summary of Selection and Success Criteria Cost Categories Design Cost Specification Cost Implementation Cost Production Cost Maintenance/Service Cost Update/Migration Cost ∑Total Cost of Flexibility Dimensions Expressiveness of the Solution Granularity of Adaptation to Initial Requirements Managing Change Persistency of the Solution Ownership 33 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 An Exemplar Approach in the Library Domain: Feature&Demand Profiling and Gap Analysis of Search Platforms used in Library Institutions Application Context SHAMAN Project Profile • Large-Scale Integrated Project • 48 months Duration • 1.300 PM effort by a Team of 60 R&D Specialists • 18 Partners from 9 Countries Welcome to the future. Welcome to SHAMAN. www.shaman-ip.eu Feature & Demand Profiling Methodology applied in SHAMAN Creation of a Multidimensional Decision Support Questionnaire about Features, Demands and other Properties of the solution 2. Production of a Multidimensional Feature Profile Scoring and Ranking Schema 3. Desk-based Research (R&D publications, white papers, marketing material) revealed RTD Feature Space for Open Source and Standard Software systems to be profiled 4. Pre-testing and Adjustment of the Profiling method 5. Interviews on-site or by phone, documentation and crosscheck with interviewees 6. Calculation and Visualization of Profile Scoring and Ranking 1. 37 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Feature&Demand-Categories used in the Profiling Categories Integration in ILS Systems Format & Migration Support Management & Administration Features for Existing Standard Functions Personalization Functions Collaboration Support Features Efficency of Search Functions Quality and Efficency of Result Presentation Openess and Customizing Support Usability, User Support Functions and „Ease of Use“ Scoring of the Interviewees during the Survey 38 # 1 2 3 4 5 6 7 8 9 0 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Feature-Category Priorities from Customers’ Point of View 12 10 8 6 4 2 0 39 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Excerpt of the Feature-Profiling Questionnaire F3.0 Browsing functions (simple and advanced search modus) Which browsing function can be influenced by the user Yes 1 Can you browse in predefined lists, hosted by the Yes system itself? 2 Can you browse in predefined lists or documents hosted on o global base? No 3 Can you sort these lists to your favor (alphabetic, theme oriented, …) No 4 In Browsing lists are there the most important information resource prioritized on top of the lists No 5 Is alphabetic browsing in different fields e.g. Authors, Magazine title, …) possible 6 Can the theme oriented structure of lists easy get don’t know adapted or changed? 7 Can you browse in newspapers to reach articles? No 8 Can you brows in Magazines to reach articles? No 9 Can you browse in Conferences to reach articles? No 10 Can the user return each time to the search mode? 40 No facets Yes I would imagine that these are not functionalities of an integrated search solution per se but more of the underlying (remote) databases. Yes Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Result Scoring used for Findings Answer of interviewee Points Standard functionality delivered with the product Functionality that can be reached with customization Functionality that is provided by the core search engine and requires configuration Not covered by the system 3 1,5 2 Will be brought in the next upcoming release Planned for future foreseeable release Out of scope or other solution gets used 1 0,5 0 Partly delivered with the standard solution 1,5 Not part of the questionnaire 41 0 0 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 General Demand-Category Ranking Question ranking Questioned function is essential Scoring Questioned function is important 1,5 Questioned function is “nice to have” 1 Questioned function is not important 0,5 Question does not influence the scoring of the systems 42 2 0 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Requirements-based Demand Ranking of Prospective Users # Requirement of interviewee 1 3 Yes, this is a “MUST HAVE” functionality Yes, if no better solution available 2 4 Yes, this is expected This is a not necessary function 6 7 Nice to have Neutral 5, 8 Don’t Know / Need to investigate 9 On the wish list 0 43 Not part of the questionnaire Points 3 1,5 2 0 1 0,5 0 1,5 0 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Calculation of Scoring Schema The calculation of the following spider diagrams has been made by the use of the following formula: Answer of the interviewee (points) * Importance of the question (factor) = Volume of points The volume of points has been summarized in Feature Categories The maximum possible feature set represents 100% The results are presented as percentage of the maximum possible feature sets in each category 44 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Feature Profiling Results of reviewed Search Platforms Primo V3.0 1 Commercial Integration ILS systems 100% 90% Usability ease of use 80% 70% Primo V2.0 1 Commercial Format & Migration support Open Source 1 VUfind Open Source 2 OCLC Touchpoint Open Source 3 Encore 60% 50% 40% 30% Openess and custom support Managmt & Administration 20% 10% 0% Quality & Efficency of result Personalization Efficency of search functions 45 Collaboration features Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Demand Profiling UNI Hagen based on Requirements Integration ILS systems 100% 90% Usability ease of use 80% Format & Migration support 70% Commercial systems that have been reviewed 60% 50% 40% 30% Openess and custom support 20% Managmt & Administration 10% 0% Quality & Efficency of result Personalization Requirements measured with Primo V2.0 the SHAMAN requirements Primo V3.0 and scoring Hagen Uni Efficency of search functions 46 Collaboration features Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Methodology applied for the FU Hagen Library Project 1. Creation of a base questionnaire within the 2. 3. 4. 5. 47 SHAMAN project for digital preservation with the focus on library institutions Review of the current situation in Hagen (as is) Prioritization of the future demanded features Generation of a Ranking Schema related to the Hagen Library Requirements (new 100% axis) Mapping of the SHAMAN System FeaturePr0filing results to the new Ranking Schema Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Requirements measured against System Landscape Integration ILS systems 160% 140% Usability ease of use 120% System 1 Commercial newest release Requirements FUH Library System 1 commercial previous release Format & Migration System 2 commercial support System 3 Open source 100% System 4 Open Source 80% System 5 Commercial 60% System 6 Open Source 40% Openess and custom support Managmt & Administration 20% 0% Quality & Efficency of result Personalization Efficency of search functions 48 Collaboration features Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Requirements measured against Commercial System 1 System 1 Commercial newest release Integration ILS systems 160% 140% Usability ease of use 120% Requirements FUH Library System 1 commercial previous release Format & Migration support 100% 80% 60% 40% Openess and custom support Managmt & Administration 20% 0% Quality & Efficency of result Personalization Efficency of search functions 49 Collaboration features Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Requirements measured against Commercial System 2 Requirements FUH Library Integration ILS systems 160% 140% Usability ease of use 120% System 2 commercial Format & Migration support 100% 80% 60% 40% Openess and custom support Managmt & Administration 20% 0% Quality & Efficency of result Personalization Efficency of search functions 50 Collaboration features Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Requirements measured against Commercial System 3 Requirements FUH Library Integration ILS systems 160% 140% Usability ease of use 120% System 5 Commercial Format & Migration support 100% 80% 60% 40% Openess and custom support Managmt & Administration 20% 0% Quality & Efficency of result Personalization Efficency of search functions 51 Collaboration features Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Requirements measured against different Open Source Systems Requirements FUH Library Integration ILS systems 160% 140% Usability ease of use 120% System 3 Open source System 4 Open Source Format & Migration support System 6 Open Source 100% 80% 60% 40% Openess and custom support Managmt & Administration 20% 0% Quality & Efficency of result Personalization Efficency of search functions 52 Collaboration features Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Gap analysis for all (combined) Open Source Systems Requirements FUH Library Integration ILS systems 160% 140% Usability ease of use 120% System 3 Open source System 4 Open Source Format & Migration support System 6 Open Source 100% 80% 60% 40% Openess and custom support Managmt & Administration 20% Gap to be filled in the project with programming resources 0% Quality & Efficency of result Personalization Efficency of search functions 53 Collaboration features Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Gap analysis Commercial versus Open Source System 1 Commercial newest release Integration ILS systems 160% 140% Usability ease of use 120% Requirements FUH Library System 3 Open source Format & Migration support System 4 Open Source System 6 Open Source 100% 80% 60% 40% Openess and custom support Managmt & Administration 20% 0% Gap to be filled in the Project with system 1 Quality & Efficency of result Personalization Efficency of search functions 54 Collaboration features Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Analysis Dimensions Total Cost of Ownership (I) Commercial system of choice 55 Cost of investment Cost of customization and consulting activities to fill the gap Cost of maintenance for a period of time (maintenance fees) Cost of migration of customization to the next following releases (number of releases in the defined period of time Cost of own administration resources Hosting cost if applicable Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Analysis Dimensions Total Cost of Ownership (II) Open Source system(s) of choice 56 Cost of API learning with function review Cost of development and quality assurance to fill the gap Cost of documentation to bring the own source code in the source code community Cost of own administration and of keeping development resources (plus eventually additionally API learning cost of fluctuation appears) Cost of quality control for new Open source releases to participate in community bug fixing related to the own installation Hosting cost if applicable Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Other Decision Criteria provided by Users/Customers Have there been technical KO criteria to exclude other vendors Pricing Option to the future (announce new functions or previews) Influencing capabilities on vendors roadmaps and priorities User network support given by other consortia partners Decision promoted by synergies with other institutions Consulting power of a certified vendor partner Consulting power and experience of the vendor Feedback from other customers, reference visits Provided test and evaluation capabilities by the vendor Quality of the presales support Market shares and installed base Solvency and reliability of the vendor Size and power of the vendor Importance 57 0 1 2 3 4 5 6 7 8 9 10 11 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Concluding Remarks There are pros and cons to selecting Open Source and Standard Software SW should be selected and used only after Careful Needs and Requirements Analysis including Profiles of own Competences vs. available Open Source Profiles and Standard Software Profiles 58 Thorough Definition of Success Criteria Systematic Evaluation of Potential Benefits versus Riscs including Total Cost of Ownership Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009 Fine. Thank you very much for your attention. Prof. Dr.-Ing. Matthias L. Hemmje Phone (InConTec): +49-9552-931494 Phone (Uni. Hagen): +49-2331-987-304 E-Mail: Matthias.Hemmje@incontec.de Matthias. Hemmje@fernuni-hagen.de 59 Open Source vs. Commercial Software Impacts on Library Infrastructures – Amsterdam, 5th of October 2009