Three trends shaping the future of enterprise search: 2010-2013 Nick Patience Research Director, Information Management The 451 Group Twitter: @NickPatience Agenda • • • • • Introduction Information governance Search-based applications Open source & OEM The future The 451 Group • Founded in 2000 • 50 analysts with deep domain expertise • Syndicated research, advisory services, conferences • Offices in NYC (HQ), London, Boston, San Francisco, Washington, D.C. • Focus on trends in enterprise IT from three perspectives: – Business – Technology – Investment & M&A • Customers: end users, VCs, investment banks, vendors Agenda • • • • • Introduction Information governance Search-based applications Open source & OEM The future Information governance Source: Information Management Reference Model, EDRM.net Information governance Information governance is the practices and technologies involved with proactively managing what information is retained, where it is stored and for how long, who has access to it, how it is protected and how and when it is deleted. Information governance Archiving eDiscovery / eDisclosure Records & storage management Information governance: drivers In 57% of organizations, recent events such as the BP disaster, the Toyota recalls, and the banking crisis have made senior management “more” or “much more” conscious of risks to the business. 26% have undiscriminating policies on deletion of all emails, 23% keep everything just in case and 31% have no policies or non-enforced policies. The remainder either manually or automatically declare important emails as records and delete the others. Source: Survey of 709 individual members of the AIIM community between July 30 & August 19, 2010 Information governance Information governance: different approaches Store everything and rely on a great search engine to find it OR Rely on a great search engine and deduplication to selectively delete what is not needed and then search what’s left Information governance: store-everything approach Pros Simpler and requires very little policy-based management Cons Storage costs increase rapidly, involves a lot of duplication, potentially stores things that shouldn’t be stored under data protection acts Information governance: selective deletion approach Pros Cons Cuts storage costs as they don’t grow in line with data stored (dedupe takes care of that) It’s hard to do But that’s where search comes in! Information governance Implications for search market? • Large part of archiving is search-based = opportunity • Tight integration needed into archiving, ECM and policy management tools • Focus on discovery, rather than search Agenda • • • • • Introduction Information governance Search-based applications Open source & OEM The future Search-based applications Search-based applications are applications that use a search index as the basis of their data management, either instead of, or alongside a relational database. Search-based applications • First mooted c. 2004 by FAST • Too big and too much customization required • Now gaining foothold • Unstructured & structured data in single index • Fuzzy matching & JOINs – answer both ‘how much?’ as well as ‘why?’ & ‘how?’ queries Search-based applications Manufacturing Commerce Call centers Search-based applications Search-based applications Search-based applications Search-based applications Implications for search market? • Potentially hugely disruptive in data management = major opportunity • Build partnerships with application vendors • Focus on developers • Focus on user interfaces Agenda • • • • • Introduction Information governance Search-based applications Open source & OEM The future Open source Open source • Developers like it – get their hands dirty • Vendors like it – use as the basis of their own search tools • Boardrooms like it – lack of upfront costs • Now part of enterprise fabric • Search just latest in series of areas to be disrupted by it, e.g. CRM, ECM, ERP, BI etc OEM OEM • Developers like it – get their hands dirty • Vendors like it – hard to replace • Fastest growing business of some vendors, incl. Autonomy • Points to future winners & losers in information governance & search-based apps Agenda • • • • • Introduction Information governance Search-based applications Open source & OEM The future Search based applications Manufacturing Commerce Call centers Predictions Trend 2010 2013 Information governance Reactive; eDiscovery Proactive; eDiscovery; investigations; security, compliance Search-based applications Custom-built, one-off; expensive; on-premise Packaged; SaaS; all verticals Open source & OEM Starting to rise in importance Basis of search-based apps; most of pure search market here Importance of search to the enterprise Information Governance Search-based Applications Enterprise Search Market implications • For many, search will be the means, not the end • Pure enterprise search devolves to open source, Google or SharePoint • Developers matter, whether in apps, open source or OEM Why do people buy enterprise search tools? Because they have to…. It may not be called search Questions? Twitter: NickPatience Blog: Too Much Information http://blogs.the451group.com/information_management/ nick.patience@the451group.com http://www.the451group.com