Capacity Management, Demand Management, and Performance Engineering Integration Ann Dowling adowling@us.ibm.com © 2009 IBM Corporation IT Optimization and Service Management The Capacity Management Process is comprised of six key Activities. Establish Capacity Management Framework: Based on the business and IT strategy and the architectural models, guidelines and a framework for capacity management will be developed. M a n a g i n g t h e P r o c e s s Model and Size Capacity Requirements: E x e c u t i n g t h e P r o c e s s – Modeling involves performance and capacity prediction through estimation, trend analysis, analytical modeling, simulation modeling and benchmarking. Application sizing is a technique that predicts the capacity solution required to meet service level requirements for response times, throughput, and batch elapsed times. Monitor, Analyze, and Report Capacity Usage: – Monitors should be established on all the components and for each of the services. The data should be analyzed using, wherever possible, expert systems to compare usage levels against thresholds. The results of the analysis should be included in reports, and recommendations made as appropriate. Supervise Tuning and Capacity Delivery: – Outputs from monitoring, analyzing, and reporting activities are examined and actions to tune individual resources or to re-balance the available capacity are planned and initiated through Change and Release Management. Produce and Maintain Capacity Plan: – The objective of this activity is to develop, maintain, test and revise alternative approaches in satisfying various enterprise-shared resource requirements. It delivers the capacity plan that addresses the customer's resource requirements. Evaluate Capacity Management Process Performance: Measurements include the definition, collection of measurements, analysis, review and reporting for Capacity Management. 2 IT Optimization and Service Management There are three sub-processes that comprise the ITIL® Capacity Management process. Each uses the primary activities of the process decomposition in differing ways, to differing stakeholders, to differing end results. Business Capacity Management (BCM) translates business needs and plans into requirements for service and IT infrastructure, ensuring that the future business requirements for IT services are quantified, designed, planned and implemented in a timely fashion Service Capacity Management (SCM) management, control and prediction of the end-to-end performance and capacity of the live, operational IT services usage and workloads Component Capacity Management (CCM) management, control and prediction of the performance, utilization and capacity of individual IT technology components "ITIL ® is a Registered Trade Mark, and a Registered Community Trade Mark of the Office of Government Commerce, and is Registered in the U.S. Patent and Trademark Office" 3 IT Optimization and Service Management Elements of Demand Management are the main source of business demand that Capacity Management uses to develop capacity forecasts and solutions. Conceptual View Business processes are the primary source of demand for services. Patterns of business activity (PBA) influence the demand patterns seen by the service providers (Figure5.23) It is very important to study the customer’s business to identify, analyse and codify such patterns to provide sufficient basis for Capacity Management. Excerpted from “Service economics” chapter of itSMF publication for ITIL® V3 core documents, 2008-12-15. Visualize the customer’s business activity and plans in terms of the demand for supporting services Note: IBM provides additional process guidance supporting Demand Management and other ITIL processes. • IBM Tivoli Unified Process (ITUP) 4 IT Optimization and Service Management And…add ITIL V3 Service Strategy Demand Management for ‘sense and respond’ alignment with client Business Transformation ITIL® Demand Management Key Activities: Establish Demand Management framework Value and classify business demands Consolidate business demand patterns and forecasts Forecast service demand Identify and plan demand management initiatives Assess and report demand management outcomes Evaluate demand management performance Capacity Management translates demand through to the component level. 5 IT Optimization and Service Management Several tasks in the Demand Management process need to be driven by the Capacity Management team in order to initiate progress toward improved capacity requirements and forecasts. Demand Mgmt. Key Activity Demand Mgmt. Task Relationship with Capacity Management Note: This is a minimal subset to provide input to Capacity Management for Demand Management 6 Value and Classify Business Demands Identify and Analyze Business Demand Streams and Demand Work with business areas to gather business demand information, analyze types of demand in business terms and obtain trend of the demand - For customers of IT, internal and external Forecast Service Demand Create Business Demand Forecasts Work with business areas to create forecasts of business demand for major business areas Assess & Report Demand Mgt. Identify Service Demand Baselines Determine existing baselines for service demand. for given business areas Forecast Service Demand Translate Service Demand to Service Consumption Units Convert service demand into service consumption units for the business areas Forecast Service Demand Translate Business Demands to Service Demands Take business demand data and results and identify demand for specific IT services Forecast Service Demand Create Service Demand Forecasts Take the Service Demands and create forecast for the required IT services (input to “Model and Size Capacity Requirements” and “Produce and Maintain Capacity Plan” IT Optimization and Service Management IBM leverages its Performance Engineering and Management Method (PEMM) for its engagements. PEMM was first outlined in 1998 in an IBM internal white paper, as a comprehensive approach to addressing performance throughout the lifecycle of a custom application development (CAD) project. It was developed into a comprehensive method with full elaboration of the eight major Themes, supporting Work Products, exploration of the Role of the Performance Architect and the mult-disciplinary Performance Engineering Team In addition to the traditional disciplines of performance testing and performance/capacity planning and management, PEMM stresses the need for proactive performance engineering tasks which should be taking place during earlier project phases (i.e. requirements, architecture, design & development) and managing the scalability, capacity and performance in the production environment. PEMM is the basis of an internal IBM course on “Architecting for Performance” that is included in the education roadmap for the IBM Architect Profession. PEMM has been customized by IBM on multiple engagements across several industries, including several large Insurance industry clients. 7 PHASES THEMES PEOPLE The three dimensions of Performance Engineering: • The project Phases and deliverables dimension defined in your project development standards • The People dimension in which you build and maintain your relationships with other key members of the project and within the Performance Engineering team itself. • The Themes dimension in which you maintain and drive forward the longer conceptual threads of activity needed to help you achieve your objectives. IT Optimization and Service Management The PEMM themes apply across the life cycle and produce a set of outputs also shared and refined throughout the life cycle. PEMM directly maps to YOUR life cycle and beyond into Introduction and Deployment. Software Development Life Cycle Startup Solution Outline Macro Design Solution Requirements Micro Design Build Deployment Solution Close ►Performance Engineering and Management Method performance engineering activities completed in the earliest part of the project to ensure performance and capacity requirements are well-defined and assessed at the outset Requirements and Early Design analyzing the quantitative (volumes) factors, both business and technical, that will effect system performance Volumetrics activities associated with predicting future performance behavior or capacity requirements of a system Performance Estimation and Modeling investigation required to make estimation and modeling more accurate and fact-based PE activities conducted during the development life cycle Design, Development, and Tracking include supporting design and code reviews and establishing performance time or resource utilization budgets test and assess the performance of the live solution, Performance Testing and Validation usually by an independent performance test team Technology Research manage performance and capacity of the deployed solution in production, using monitoring tools and processes and service level agreements Live Monitoring and Capacity Management Risk and Performance Management Outputs ensure risks related to performance and capacity are properly identified, assessed and addressed 8 PE Strategy Non-Functional Requirements Business Volumetrics PE Risk Assessment and Containment Plan PE Plan Performance Critical Use Cases Technical Volumetrics Performance Budgets Performance Model Application Profiles Capacity Sizing Monitoring Plan Performance Test Cases Measurement Specifications Performance Analysis Results Tuning Recommendations Performance Service Levels Monitoring Thresholds/Alerts Implemented Tuning Capacity Plan Capacity Plan vs. Actual reports IT Optimization and Service Management Integration points foster mutual awareness and collaboration between the Capacity Management process and Performance Engineering themes which mutually strengthens the overall effectiveness. Capacity Planning for a future system deployment Capacity Management for a deployed system Capacity Management view as embodied in ITIL and IBM’s ITUP Business Supervise Tuning and Capacity Delivery Model and size capacity requirements Monitor, Analyze and Report Capacity Usage (Service Management perspective) Performance Engineering view as embodied in PEMM (Solution Design and Delivery perspective) Volumetric s Requirement s and Early Design Estimatio n and Modeling Service Design, Developmen t and Tracking Technolog y Research Test Planning and Execution Produce and maintain capacity plan Live Production Component Performance Engineering of a solution being developed and/or assembled Performance Management of a solution being deployed 9 IT Optimization and Service Management The convergence of Capacity Management, Demand Management, and Performance Engineering (PEMM) provides a powerful and truly full life cycle methodology. Demand Management Patterns of Business Activity and Demand Policies Performance Engineering Risk Assessment Non-Functional Requirements Performance Model Capacity Management Information System & Capacity Plan Performance Engineering & Management Method (PEMM based) Capacity Management Process (ITIL® based) Feasibility 10 Design Development Test • IBM’s Performance Engineering & Management Method (PEMM) • IT Infrastructure Library (ITIL®) Deploy Production Optimize IT Optimization and Service Management Model and Size Capacity Requirements Supervise Tuning and Capacity Delivery Model and size capacity requirements Produce and maintain capacity plan Monitor, Analyze and Report Capacity Usage Volumetrics Requirements and Early Design Estimation and Modeling Technology Research 11 Design, Development and Tracking Live Production Test Planning and Execution IT Optimization and Service Management Model and Size Capacity Requirements Modeling involves performance and capacity prediction through estimation, trend analysis, analytical modeling, simulation modeling and benchmarking. Modeling can be performed for all or any layer of the IT solution including the business, application and technology infrastructure. Application sizing is a technique that predicts the service level requirements for response times, throughput, and batch elapsed times. It also: • predicts resource consumption and cost implications for new or changed applications • predicts the effect on other interfacing applications. 12 IT Optimization and Service Management Modeling involves one or more techniques must be selected when modeling workload behavior and associated resource requirements. Modeling Objectives: – Predict the behavior of IT Services under a given volume and variety of work using: • • • • • • • Pilot studies Prototypes Full scale benchmarks Trend analysis Analytical modeling Simulation modeling Baseline models Like modeling and forecasting during a solution development project: – No single technique can apply to all situations – One or more techniques must be selected when modeling workload behavior and associated resource requirements 13 IT Optimization and Service Management Application Sizing has a strong correlation with Performance Engineering. Application Sizing Objectives – Estimate resource requirements for new or changed application – To ensure it meets required service levels – Has to be an integral part of the applications lifecycle Application sizing has a finite life-span – Initiated at Project Initiation stage for a new application – Major Change to an existing Application – It is performed at the beginning of the solution lifecycle and continues through the development, testing and implementation phases. Service Levels defined – During initial systems analysis and design – Enables use of pertinent technologies & products – Easier and less expensive to consider early in application lifecycle Modelling can be used within Application Sizing Applies to Application Packages (COTS): – Research similar customers & do benchmarks 14 IT Optimization and Service Management The Testing / Modeling Continuum is a guide to determining which forecasting technique should be used in a particular situation. Cost & Time Benchmark Linear Extrapolation Full Production Test Testing + Simulation Model Testing + Analytic Model Scalability Testing Simulation Model Analytic Model Forecast Accuracy 15 +/- 10~15% +/- 5~10% IT Optimization and Service Management Capacity modeling can be utilized to project the infrastructure requirements for any production or test based application. Basic Capacity Planning (Scalability) Methodology Identify key workloads / transactions and develop a performance metric collection strategy Collect performance and configuration data required to construct the models Create and calibrate the model to base system metrics Utilize the calibrated baseline model to project future business scenarios Analyze modeling results and identify application and infrastructure requirements Create and deliver final report and softcopy performance models App Model Projections 20 80 15 60 10 40 5 20 0 0 100 150 200 250 300 350 400 450 Total Users 16 Response Time (sec) CPU Utilization (%) 100 Server1 Server2 Server3 Tran1 Tran2 CTC CTC CTC CTC CTC Dealer KPI Dealer KPI Dealer KPI Dealer KPI SAS Enterprise Guide SAS Enterprise Guide SAS Enterprise Guide SAS Enterprise Guide VPIPE VPIPE VPIPE VPIPE DRBA DRBA DRBA Transaction 1a (Total) 4b (Total) 7a (Total) 8a (Total) 11b (Total) 15a (Total) 21a (Total) 22a (Total) 29a (Total) 34b (Total) 39a (Total) 45a (Total) 51a (Total) 54a (Total) 57a (Total) 59a (Total) 61a (Total) 67a (Total) 71a (Total) 75a (Total) Time in Seconds Application Network RespT ProcT NetT App Turns AppMsgs AppData NetPkts NetData 0.27 0.08 0.19 11 13 18,835 44 25,598 2.49 2.47 0.01 91 92 274,854 522 348,122 3.04 3.02 0.03 23 25 284,361 493 333,321 4.70 4.67 0.02 23 25 284,945 495 336,933 1.41 1.36 0.01 132 136 183,193 440 245,781 0.06 0.06 0.00 11 16 11,825 26 13,259 3.16 3.14 0.02 775 863 242,527 1,034 298,943 0.19 0.17 0.02 75 198 264,036 447 288,924 1.87 1.84 0.03 3,905 3,924 184,708 3,933 397,158 38.97 38.53 0.44 1,312 2,621 878,389 4,010 1,104,002 276.00 275.16 0.84 2,032 4,019 827,170 5,605 1,145,303 1.61 1.45 0.16 438 878 250,614 1,297 324,043 238.07 237.72 0.34 530 1,045 272,794 1,526 360,396 0.19 0.19 0.00 29 31 6,220 36 8,208 4.06 4.06 0.00 5 8 4,909 13 5,641 30.32 30.32 0.01 109 121 58,588 161 67,522 106.41 105.73 0.67 16,928 16,959 7,528,632 20,739 8,671,263 0.14 0.14 0.00 3 4 3,875 7 4,265 139.43 139.23 0.19 3 4 3,579 9 4,089 7.49 7.49 0.00 3 4 544 7 940 IT Optimization and Service Management Monitor, Analyze, and Report Capacity Usage Supervise Tuning and Capacity Delivery Model and size capacity requirements Produce and maintain capacity plan Monitor, Analyze and Report Capacity Usage Volumetrics Requirements and Early Design Estimation and Modeling Technology Research 17 Design, Development and Tracking Live Production Test Planning and Execution IT Optimization and Service Management Monitor, Analyze, and Report Capacity Usage Monitors should be established on all the components and for each of the services. The data should be analyzed using, wherever possible, expert systems to compare usage levels against thresholds. The results of the analysis should be included in reports, and recommendations made as appropriate. There is a fundamental level of data collection and reporting necessary in any environment before capacity and performance services can be established. Monitors and Data Collection and Reporting suites might be required at many levels, including but not limited to, the operating system, the database, the transaction processor, middleware, network, Web Services, and end-to-end (user) experience. 18 IT Optimization and Service Management Objectives of Monitoring and Analysis Monitoring objectives: Measure the utilization of each resource and service on an on-going basis to ensure: – the optimum use of the hardware and software resources – that all agreed service levels can be achieved – that business volumes are as expected Analysis objectives: Identify trends from which the normal utilization and service level, or baseline, can be establishes Identify exception conditions in the utilization of individual components or service thresholds by regular monitoring and comparison with the baseline thresholds Identify and report breaches or near misses in the SLAs Predict future resource usage, or monitor predicted growth against actual business growth (plan vs. actual) 19 IT Optimization and Service Management Several categories of monitoring are within the scope of the Capacity Management process. 20 Utilization Monitoring Response Monitoring Processor utilization Memory utilization Per cent processor per transaction type IO rates (physical and buffer) and device utilization Queue lengths Disk utilization Transaction rates Response times Batch duration Database usage Index usage Hit rates Concurrent user numbers Network traffic rates. Incorporating specific code within client and server applications software (application instrumentation) Using ‘robotic scripted systems’ with terminal emulation software Using distributed agent monitoring soft Using specific passive monitoring systems Durations for Monitoring Real-time (events) Historical – Problem determination and root cause analysis – Trend analysis – Planning IT Optimization and Service Management Composite application monitoring and management offers end-to-end visibility within applications and infrastructure components. Secure Zone DMZ Voice Services Insesure Zone VPN Rel. DB Process Server Application Servers Agent Agent Gateway Internet Portal Service Registry Agent Partner Services Agent Existing Applications Web Servers Customers Connectors Enterprise Service Bus Connectors Adapters Adapters Agent Web Servers Integrated Service Composite Application Management Monitoring & Management 21 Intranet Émployees Infrastructure Services Security Services IT Optimization and Service Management The ITIL Capacity Management sub-processes are carried out across several key activities. Source: ITIL Service Design © Crown Copyright 2007 According to ITIL, a CDB or CMIS is a cornerstone of a successful Capacity Management process. 22 IT Optimization and Service Management Data Collection begins with establishing a methodology for ensuring that data and measurement requirements are well understood and can be achieved. Data collected must account for resource usage, accommodate forecasts, and provide for monitoring and tuning the system. –Which tool(s) to use for data collection and reporting • Metric data – data repository • Non-metric data – document repository –Frequency of collection and summarization • Detail, hourly, daily, weekly, monthly, quarterly • Peak vs. average –View of data / information • Business, Application, or Project view • Service view • IT Component view • Location view –Levels of detail • Shared vs. dedicated resources • Workload level (i.e., process id) vs. transaction level 23 The CMIS (Capacity Management Information System) repository will be the primary source of the system data needed for forecasting. Carefully designed categorization of data allows for flexibility in reporting and analysis from various views. IT Optimization and Service Management A diverse set of data and information can be compiled into a set of application profiles valuable as both inputs and outputs throughout the Capacity Management process. Business data – Business transactions – Schedule of business events – Business drivers Service data – Response Time service objectives / levels – Elapsed time, End time, Turnaround Time, Throughput – Maintenance windows Technical data – CPU type, model, serial – available capacity (MIPS), memory (Central and Expanded), channels, number of cps, speed of cps, weight – Operating System, Subsystems Financial data – Financial plans – IT budgets, including specific budgets for hw and sw expenditure – external suppliers, for cost of new hw and sw upgrades Utilization data – IT resource measurements by workload groupings • CPU resource usage (utilization) • Storage usage (utilization) 24 A composite of all this information can be organized into a set of application or workload profiles. Nonmetric and metric data Application xyz Application abc Workload 123 Application or Workload Profiles provide the workload characterization: Application behavior over time patterns, peaks Aggregation or groupings Growth requirements, growth scenarios Various analysis and reporting are also derived from use of the CDB or CMIS. IT Optimization and Service Management A common, standard set of resource usage data can be shared by performance, capacity, and usage-based show-back to forecast and manage IT demand. Consistent, standardized data collection is crucial to ensure that the metrics needed for performance monitoring, capacity planning (forecasting), and chargeback are readily available. Raw Data from Agents Event Monitoring and Management • Alerts, Alarms • Thresholds Short Term: performance bottleneck analysis (IT resource, application, process, or thread level) • Problem determination • Root cause analysis Long Term: Capacity Planning • Trending, plan vs. actual analysis • Forecasting • Sizing • Modeling, statistical regression IT Accounting: usage-based chargeback • Pricing • Billing • Forecasting • Variance analysis Time Range 25 Metrics collected from various platforms, databases, sub-components and applications address the entire range of scope – from immediate alerts and problem determination to long term capacity planning and usage-based billing. It is very important to determine which metrics to collect on an ongoing basis, with varying levels of detail applicable to specific situations. It is crucial to map resource usage metrics to the corresponding applications and business units consuming the resource. IT Optimization and Service Management Supervise Tuning and Capacity Delivery Supervise Tuning and Capacity Delivery Model and size capacity requirements Produce and maintain capacity plan Monitor, Analyze and Report Capacity Usage Volumetrics Requirements and Early Design Estimation and Modeling Technology Research 26 Design, Development and Tracking Live Production Test Planning and Execution IT Optimization and Service Management Supervise Tuning and Capacity Delivery Outputs from monitoring, analyzing, and reporting activities are examined and actions to tune individual resources or to re-balance the available capacity are planned and initiated through Change and Release Management or through the Service Desk in the case of simple requests to other support groups or self-help for users. Some recommendations might involve changes in the way that the users use the IT systems: – moving discretionary workloads to off-peak periods – performing a business function using a more efficient IT service path – balancing services – changing concurrency levels – adding or removing resources The cycle then begins again, monitoring any changes made to ensure they have had a beneficial effect and collecting the data for the next day, week, or month. 27 IT Optimization and Service Management Supervise Tuning and Capacity Delivery Service and component tuning: – enables effective utilization of IT resources by identifying inefficient performance, excess or insufficient capacity, and making recommendations for optimization. It can – balances the need to maintain service while reducing capacity capability to reduce the cost of service. Understanding the combined performance impact of various components within a complex infrastructure is needed to accurately differentiate symptoms from actual problems. This level of understanding provides the most accurate baseline for future planning. 28 IT Optimization and Service Management Various techniques can be used for tuning. Tuning objectives: Identify areas of the configuration that could be tuned to better utilize the system resource or improve the performance of the particular service Implementation objectives: Introduce to the live operation services any changes that have been identified by the monitoring, analysis and tuning activities Tuning techniques that are of assistance include: Balancing workloads and traffic – transactions may arrive at the host or server at a particular gateway, depending on where the transaction was initiated; balancing the ratio of initiation points to gateways can provide tuning benefits Balancing disk traffic – storing data on disk efficiently and strategically, e.g. striping data across many spindles may reduce data contention Database locking strategy - definition of an accepted locking strategy that specifies when locks are necessary and the appropriate level, e.g. database, page, file, record and row – delaying the lock until an update is necessary may provide benefits Efficient use of memory – may include looking to utilize more or less memory, depending on the circumstances 29 IT Optimization and Service Management Produce and Maintain Capacity Plan Supervise Tuning and Capacity Delivery Model and size capacity requirements Produce and maintain capacity plan Monitor, Analyze and Report Capacity Usage Volumetrics Requirements and Early Design Estimation and Modeling Technology Research 30 Design, Development and Tracking Live Production Test Planning and Execution IT Optimization and Service Management Produce and Maintain Capacity Plan The objective of this activity is to develop, maintain, test/model and revise alternative approaches in satisfying various enterprise-shared resource requirements. •Inputs: –forecast assumptions –forecast projections –subject matter expert recommendations • Controls: –financial constraints –hardware constraints –performance policies –resource standards and definitions –strategy and direction. •Deliverables: –agreed capacity plan –alternative solutions –optimized resource solution 31 IT Optimization and Service Management Forecasted resource requirements (demand) can provide quantified IT resource ‘volumetric’ input (load) to testing or modeling studies that analyze the impact of the projected IT resource load and exercise various solution alternatives to satisfy the demand. Establish Baseline: Define Content and Scope Select representative time Period Determine Metrics to characterize Determine time Durations Develop forecast requirements (demand): Define objectives of forecast Determine forecasting horizon Select appropriate set of forecasting techniques Define growth scenarios • Conservative, Most-likely, Aggressive Quantify forecasted requirements (demand) into IT resource requirements (load) over time Conduct Testing / Modeling Studies: Calibrate the baseline Apply forecasted requirements (demand) against baseline Analyze impact of forecasted IT resource volumetrics (load) over time Exercise various solution alternatives Document assumptions and risks Recommend conservation actions Capacity Plan: Consolidate growth plans for all workloads • existing workloads • new applications, enhancements to applications • changes to the IT environment / infrastructure Recommend solutions Document associated approaches, assumptions, risks Track through plan vs. actual analysis 32 IT Optimization and Service Management IT resource usage Capacity planning is needed to help evaluate existing and new applications, as well as changes in your business environment. Each of the three major sources of growth must consider the impact of business growth expectations and planned business events. ENVIRONMENTAL CHANGES NEW APPLICATIONS GROWTH IN EXISTING APPLICATIONS BASELINE USAGE t0 Time t1 Capacity planning mission The goal of the capacity planning process is to help ensure that sufficient costeffective capacity is available to meet existing service level commitments, as well as business and application growth requirements. 33 IT Optimization and Service Management Composite views of IT resource estimates are developed based on the aggregation of the individual resource requirements. All of the requirements are summarized, or subtotaled, to develop an aggregate or composite view of the overall, enterprise-wide resource requirements or demand IT resource composite views can include: – – – – – – Servers Storage Data Network Voice Network Middleware Database A composite view of IT resource requirements can be analyzed at various levels of breakout and detail: – – – – 34 Locations Key applications/workloads Business functions Physical processors IT Optimization and Service Management Individual requirements are developed at a more detailed level that is typically based on a reasonable set of key applications/workloads. Workload grouping assists in determining what level of detail provides an effective aggregation for a composite view that is reasonable and appropriate for the Capacity Plan. Workload grouping: Defining key applications/workloads – Top resource load Group or Aggregate like application/workloads – Similar resource usage characteristics • By IT resource component: an application / workload could surface as ‘key’ in some component areas and not in others – Similar growth characteristics: one or more of these factors can justify aggregation: • • • • • 35 Similar seasonal trends Similar growth rates (monthly, annually) Similar historical trends Similar business drivers (estimation or correlation) Similar impact from business events IT Optimization and Service Management Validation of forecasts must be done on a regular basis. One common approach is plan vs. actual analysis. If the actuals deviate significantly or consistently from the plan then investigation into the cause and possible adjustment to the forecast is necessary. EXAMPLE ONLY 2084-305 CECA Average Monthly MIPS Used and Forecasted by LPAR Shift xxx: startday - endday (starttime - endtime timezone) 2000 1800 1600 MIPS 1400 1200 1000 800 600 400 200 A ug -0 9 9 -0 9 Ju l Ju n0 ay -0 9 M -0 9 A pr -0 9 ar M b09 Fe Ja n09 D ec -0 8 O ct -0 8 N ov -0 8 Se p08 A ug -0 8 -0 8 Ju l 8 Ju n0 ay -0 8 M -0 8 A pr -0 8 ar M b08 Fe Ja n08 D ec -0 7 O ct -0 7 N ov -0 7 0 Month MVSP DOFD MVSZ MVSI Total installed (1983 MIPS) 36 MVSW WSS1 MVSB DOFZ ACTUALS DOFP HRAP PHYSICAL 80% - planning threshold (1586.4 MIPS) IT Optimization and Service Management Once the source of the deviation from plan has been determined then the cause of the deviation must be investigated. What forecasting technique was used ? – If business-driven, has the business driver forecast changed ? – If historical trend, has some change been introduced that was not known ? – Is there an unplanned business event or project that has occurred and is potential impacting the workload ? Is it possible to drill down further within the workload to further isolate the source of the deviation ? – perhaps at the application level Are there any related problems that have been reported, such as response time degradation, etc. ? What is the degree of risk/impact from this deviation ? – Is a forecast adjustment necessary ? How do I adjust the forecast ? – One time event only ? – Seasonal adjustment ? – Long term adjustment ? Why do I adjust the forecast ? – What assumptions need to be modified ? – Is a different forecasting technique more appropriate ? What measurements do I have to quantify the necessary adjustments ? What measurements were used to quantify the baseline and the forecasts ? Was the baseline valid or does it have some inherent problems or exceptions that need to be resolved ? What were the assumptions ? Without sufficient levels of data grouping, it can be very difficult to drill down to the probable source of the deviation and therefore difficult to determine the cause of the deviation of actual to plan. 37 IT Optimization and Service Management The convergence of Capacity Management, Demand Management, and Performance Engineering (PEMM) provides a powerful and truly full life cycle methodology. Demand Management Patterns of Business Activity and Demand Policies Performance Engineering Risk Assessment Non-Functional Requirements Performance Model Capacity Management Information System & Capacity Plan Performance Engineering & Management Method (PEMM based) Capacity Management Process (ITIL® based) Feasibility 38 Design Development Test • IBM’s Performance Engineering & Management Method (PEMM) • IT Infrastructure Library (ITIL®) Deploy Production Optimize IT Optimization and Service Management Integrating work products into the existing phases or gates of the SDLC, project management, and other key business and service management processes helps to operationalize or institutionalize PE. Phases & Work Products (Data and Tools) PHASES THEMES & ACTIVITIES PEOPLE What the team needs to do or to produce in each phase of the project. Organization People in the project that you need to work with to achieve your objectives Method / Process (Themes / Activities) Long term elements of system design, development, and delivery that interact with Performance Engineering 39 IT Optimization and Service Management The role of the Performance Engineer or Performance Architect requires multi-faceted skills and responsibilities. A person who carries out performance engineering duties and leads a Performance Engineering project or team is referred to as a Performance Engineer or Performance Architect. Performance Engineering is most successful when it is carried out by a multi-disciplinary team representing the major business and technical stakeholders in a project or solution: – – – – – – – 40 Requirements Analysts Architects Developers Infrastructure and Application Engineers Testers Capacity Planners Performance Analysts IT Optimization and Service Management 41