Enterprise Architecture 2.0: Accelerating Transformation at StatCan Robert McLellan Chief Enterprise Architect April 25, 2013 Enterprise Architecture 2.0 What do we mean by “Enterprise Architecture 2.0?” 1. Adoption of a Service-Oriented Architecture (SOA) approach to our enterprise architecture 2. A shift in focus beyond “bottom-up” technology standardization to service portfolio management (business services / IT services linkage) 3. Address the “business process management” gap 4. Leverage international models and standards in our enterprise architecture – be part of the Common Statistical Production Architecture (Plug and Play) movement 2 Statistics Canada • Statistique Canada Corporate Business Architecture (CBA) StatCan’s modernization program was created in 2010 with these objectives: • • • 3 Create harvestable efficiency on on-going operating costs to meet financial goals for savings and investment Enhance quality assurance through implementation of a reduced, unduplicated set of more robust systems and processes Improve responsiveness in delivery of new statistical programs through streamlining of core business processes Phased implementation – transformation projects organized in waves Key CBA Principles Corporately optimal decision making (away from locally optimal) Meta-data driven processes Optimize use of corporate services, centralizing where there is leverage from economies of scale, pooling of resources (e.g. Collection, Dissemination) Maximize reuse through achieving smallest number of distinct business processes and enabling computer systems Minimize toolkits (software tools) Strong Statistical Information Management – Data Service Centre GSBPM is the core business process framework Preliminary CBA Services Identified Methodology service Business and institutional frame service Household frame service Questionnaire design resource centre Collection service Operations service Data service centre (Statistical IM) Internet dissemination service Inquiry service Processing service (business and social) Enterprise Architecture 2.0 What do we mean by “Enterprise Architecture 2.0?” 1. Adoption of a Service-Oriented Architecture (SOA) approach to our enterprise architecture 2. A shift in focus beyond “bottom-up” technology standardization to service portfolio management (business services / IT services linkage) 3. Address the “business process management” gap 4. Leverage international models and standards in our enterprise architecture – be part of the Common Statistical Production Architecture (Plug and Play) movement 6 Statistics Canada • Statistique Canada Preliminary Enterprise Architecture View Program Activity Architecture Add this This is an example of an approach being used by some Government of Canada departments EA needs to deliver better “tools” to planning and portfolio management to support decision making Current focus 7 Statistics Canada • Statistique Canada Business Services Information Systems / Enablers GC IT Services Current IM/IT Portfolio Target Suites Technology Reference Model Preliminary View – Statistical Business Services Statistical Production Services Data file finalization Aggregate calculation Weight calculation New variable and statistical unit derivation Imputation Review, validation, and editing Data classification & coding Data integration Production system finalization & release Statistical business process testing Production system testing Workflow configuration Process component build Data collection instrument Production systems & workflow design Statistical process methodology Action planning Evaluation execution (conduct) Evaluation input gathering Data & associated metadata disposition Data & Associated metadata preservation Archive repository management Archive rule definition User support management Dissemination product promotion Dissemination product release management Dissemination product production System output updating <tbd> Modeling Analysis Concordance Management Classification Updating Classification Definition Metadata export Metadata Search Metadata import Geo Data management Data validation Data acquisition Business register Address register <tbd> QDRC <tbd> <tbd> <tbd> <tbd> International Collaboration <tbd> <tbd> <tbd> Business Methods Frame & Sample Methodology Output finalization Disclosure control application Scrutinizing & explaining Output validation Data output preparation Collection finalization Collection operation Collection set-up Sample selection Social Methods Collection Methodology Variable description Output design Business case preparation Data availability validation Concept identification Output objective planning Stakeholder consultation Information needs analysis Statistics Canada • Statistique Canada 8 Other Macro Accounts Classification G o e Metadata Management Admin data management Register Services Household Methods Quality services Research & Dev’t Statistical Analysis & Modeling Statistical Infrastructure Services Methodology Services Performance evaluation Archive (statistical) Dissemination Analysis Collection Processing Build Design Needs analysis Motivation for change ! Enterprise complexity drives inefficiency and limits responsiveness 9 Statistics Canada • Statistique Canada Government of Canada (GC) Factors Government “Infrastructure as a Service” • Shared Services Canada (SSC) was created in 2011 to provide datacenter, network, and corporate email services • Future vision – “government cloud service provider” Back-office “Software as a Service” • Prescriptive standards for Enterprise Resource Planning (SAP, PeopleSoft) • Prescriptive standards for Document and Record Management (OpenText ECMS) • Departments encouraged to form “hosting clusters” Centralized procurement of desktop solutions Clear architectural layering and decoupling is essential to manage change, service performance, continuity of operations • 10 E.g. changes in network topology, email-enabled systems, hosted solutions Statistics Canada • Statistique Canada Views Open Group Service Integration Maturity Model Increasing maturity (SOA) Source: http://www.opengroup.org/soa/source-book/osimmv2/model.htm 11 Statistics Canada • Statistique Canada Why do we need to change? Monolithic. No integration. Monolithic. Some layers or tiers. Point-to-Point Current State ESB = Enterprise Service Bus BPM = Business Process Mgmt 12 Enterprise-wide. Services + SOA patterns. Some ESB Crossorganizational. Layers or tiers. More integration Target State(s) Enterprise-wide. Composite Services ESB Statistics Canada • Statistique Canada Adaptive Enterprise Dynamic reconfig. by Biz Analysts. Dynamic integration. Integrated across the enterprise and external partners. ESB + BPM StatCan “Anchor” Model Core Production Segments Business Surveys Processing & Analysis Input Channels System of National Accounts& Analysis Collection Dissemination Social Surveys Processing & Analysis Output Channels Census Processing & Analysis GC back office Corporate Administrative Processes Coding Core Statistical Services Questionnaire Design Sampling Edit & Imputation Estimation Tabulation / Analysis Modelling Confidentiality Core Information Services Technology Layer Data Registry 13 Tax Address Registry Core Technology Platforms Doc’t / Record Mgmt Office Productivity Business Registry Portal Geography WCMS GIS Enterprise Application Integration Identity & Access Mgmt Information Mgmt Other Metadata ERP Databases Statistical Data Mgmt File Svcs Workflow / BPMS CRM BI / DW Core Infrastructure Services (Data Centre, Network, Email, Desktops, Virtualization, Archive, IT Security Services) Statistics Canada • Statistique Canada Classification Collaboration App’n Technology Statistical Analysis SSC Typically, no given organization is at the same level of maturity in each of these dimensions. It is not atypical to find, say, an Application development maturity of Level 3, but a Business maturity of Level 1 at a given organization. The value of the table in Figure 6.1 is to not only map the current level of maturity for a given organization (or department within an organization) along various dimensions, but to also show how a given project roll-out will help in increasing the maturity of the department/organization along these various dimensions of maturity. StatCan Enterprise Application Integration Platform (EAIP) 6.3 Investigation started in 2008 with business analysis Acquired Oracle BPM Suite platform in May, 2013 • • • • • Enterprise Service Bus BPM Engine for process automation and orchestration Business Activity Monitoring (in support of dashboards, operations) Service Registry and Repository Complex Event Processing engine Lead solution project – Integrated Business Statistics Processing platform (IBSP) 14 Operationalizing Service Oriented Integration through Planned Projects When seeking to begin transformation of an education institution’s IT systems to a more service oriented approach, it is important to take the long term, strategic perspective as well as the tactical pragmatic perspective. The strategic perspective lays the vision and roadmap, while the tactical approach ensures that your current projects deliver value while taking you towards the realization of the overall vision. Core Information Services z EAIP SOA Governance IBSP, CBA Figure 6.3 Four Step approach to SOA. Sample SOA 4-step roadmap Service oriented architecture always places an extraordinary level of importance on the enterprise domain and the need for alignment between the capabilities of technology and the services being delivered by the enterprise. Furthermore, given the high number of packaged in Education, to take that first, holisticfor view of the Source:applications “White Paper: Adoptionit is of imperative Service Oriented Architecture organization and its IT architecture and Systems lay down an for the Enterprise. In other words, Enterprise in integration Education:strategy Recommended Practices” (September understanding the IT systems that need to integrate with each other coupled with an understanding of the data elements 2009) http://www.imsglobal.org/soa/ that flow between them greatly simplifies the creation of a flexible and agile service oriented architecture. Statistics Canada • Statistique Canada IMS Global Learning Consortium, Inc. www.imsglobal.org 25 of 69 Target Service Suites Statistical Production Services Collection Services • Survey Planning Instrument Generation ICOS Governance Sample Management Training Collected Data Management Response Collection Workload Management HR Management • • • • • • • • • Logistics Case Management • Response Processing Collection Systems Operation Survey Pre-Production Testing Survey Progress Monitoring Pre-Collection Respondent Communication Respondent Support Internal Communication • Web service / EAIP services 15 15 • Web service / EAIP services Admin Data Management • • • • To be determined Data validation Data acquisition Data management To be determined Alignment with FGP ? Data Service Centre(s) • • • • • • • • • “New Dissemination Model” Single Output Database CLF compliance OpenData portal Syndication Social Media Web Services Census 2016 Platform Metadata Management • • • • • dataset Statistics Canada• • Steady-state Statistique Canada management DSC NDM To be captured C-2016 Geography Services • • • Dissemination Services Census Tabulation Confidentiality Sampling Edit & Imputation Etc. Statistical Infrastructure Services Address Register Services Common processing platform for all socioeconomic, labour, health surveys Generalized Systems Services G-Suite Business Register Services • Common processing platform for all business / microeconomic surveys Environmental ? • • • • • Macroeconomic Analysis & Modeling SSPE IBSP ICOS • • • • • • • • • Social Processing Services Business Processing Services Search / discover Statistics Canada • Statistique Canada Statistical Metadata • Management Strategy • implementation • Metadata Portal Stewardship Model repository? Metadata search Classification Services Classification Management Concordance Management Common services CCE Key Transformation Projects Enterprise Architecture 2.0 What do we mean by “Enterprise Architecture 2.0?” 1. Adoption of a Service-Oriented Architecture (SOA) approach to our enterprise architecture 2. A shift in focus beyond “bottom-up” technology standardization to service portfolio management (business services / IT services linkage) 3. Address the “business process management” gap 4. Leverage international models and standards in our enterprise architecture – be part of the Common Statistical Production Architecture (Plug and Play) movement 16 Statistics Canada • Statistique Canada Client User Pathways A client user pathway represents the flow of interaction between a client (user) and a system towards an eventual outcome. The word “system” is used in the general sense, and doesn’t have to represent an IT system specifically. Diagrams Source: James Kelway, http://userpathways.com 17 Statistics Canada • Statistique Canada Statistical SOA Value Proposition As discussed at MSIS 2011, 2012 (Engdahl et al.) Process-driven approach to solution delivery Design-time and run-time binding of functionality SME, Methodology, Business Process Designers can create their own solutions via configurations, process design changes Addresses the Design / Build bottleneck (SNZ paper) Anchored on GSBPM, GSIM 18 Source: Tentative anatomy of a new generation of IT-architecture to support GSBPM-processes, Jakob Engdahl and Hans Irebäck, Anders Holmberg Statistic Sweden, Sweden MSIS 2011 Luxembourg Statistics Canada • Statistique Canada How do we design, use, and manage statistical production processes? How will Subject Matter, Methodology, Statisticians design, configure, and use solutions? What are the key roles? • • • • Service portfolio management • 19 Business Analysis Business Process Design / BPM automation Developers, Assemblers Operators, … Identification, design, delivery of services Role of Enterprise Architecture Statistics Canada • Statistique Canada Source: Combining Business Process Management and Enterprise Architecture for Better Business Outcomes, Jensen, Cline, Owen. IBM Redbooks. March 2011 StatCan and “Plug and Play” StatCan hosted Plug and Play Architecture Sprint 1 in Ottawa • Draft 0.1 out for controlled review Next generation of component sharing and collaboration • “Beyond Banff and Blaise” Potential to make important contributions to our collective transformation 20 Statistics Canada • Statistique Canada Conclusion We have embarked on the next part of our Enterprise Architecture “journey” at StatCan • Adoption of a Service-Oriented Architecture (SOA) approach to our enterprise architecture • A shift in focus beyond “bottom-up” technology standardization to service portfolio management (business services / IT services linkage) • Address the “business process management” gap • Leverage international models and standards in our enterprise architecture – be part of the Common Statistical Production Architecture (Plug and Play) movement Our goal is to accelerate the realization of StatCan’s Corporate Business Architecture transformation 21 Statistics Canada • Statistique Canada