IBM Workload Automation Graphical UI Xavier Giannakopoulos, C&SI Tiger Team EU 1 © 2014 IBM Corporation Interconnected applications, big data and cloud delivery models increase complexity of daily operations WA as cost center Pressures to expand and modernize Batch workloads bring customers to move from job scheduling to a workload automation approach The Workload Automation cycle proposes a proven solution to structure and govern the publication and maintenance of automation Model and Prepare Analyze and improve Adjust for Un -Planned events Plan and Activate the near term Execute the status / plan 2 © 2014 IBM Corporation Our persons – who accesses the IWA Operator: responsible for correct execution of the workload. Detects problems and starts reacting to resolve the problem. 3 Engineer: responsible to design the best mechanisms, and provide deep analysis for difficult problems. Will enter into play in case of problem to collaborate with Operations Business: holds the P&L responsibility for the business. Wants no disruption, best service, and short recovery time if something happens. © 2014 IBM Corporation Scenario 1: even in the best shops, it happens to 4 REPAIR Powerful views Accurate change records Let me find you the design of this part. I remember we had some weakness there. Efficient gesture Integrated interfaces Auto-documenting Rapid access to information When will it be on? How much damage? Are we compromised? Updated information Reliable estimates Speed I’m 150% on this, but I need time to work it out 4 © 2014 IBM Corporation Scenario 2: PREVENTING is much better than repairing How are we this year on our 99% SLA? Statistical view Simulate effect of change Data interface Action interface Proactive view See overall picture The statistics have been worsening for this group of job in the last 3 weeks. It corresponds to the installation of this library Quality metrics Risk assessment We have about 3 hours before the delay impacts us. 5 © 2014 IBM Corporation Scenario 3: when you get rolling it’s time to OPTIMISE Statistical view Back tracking capability Proactive view Impact analysis Tight coupling with change mgmt Let me sign off to dismiss these 1500 useless jobs We’ve been working with the team generating the highest number of error per job. Their stats have improved by 60% Clear, actionable improvement steps We expect a 2 hours bump tomorrow to absorb an extra task 6 © 2014 IBM Corporation Scenario 1: even in the best shops, it happens to 4 REPAIR Powerful views Accurate change records Let me find you the design of this part. I remember we had some weakness there. Efficient gesture Integrated interfaces Auto-documenting Rapid access to information When will it be on? How much damage? Are we compromised? Updated information Reliable estimates Speed I’m 150% on this, but I need time to work it out 7 © 2014 IBM Corporation Ops: ISPF is a safe play – in continous evolution • ISPF panel restyling enhances the speed of use in TWS z/OS • Aggregate information in scrollable panels, easier navigation, enhanced help. Scrollable view Application Description and Current Plan object attributes 8 Action bars, and all available commands at fingertips Scrollable view for list of Application Description and Current Plan objects © 2014 IBM Corporation Ops: sum-up views for jobs, jobstreams, computers 99 © 2014 IBM Corporation Operations need quick navigation Right click Workload Editor List view Single Jobstream Precise manipulation “Speed tools” Graph view External Doc Process Increase the use of direct paths Link Products together with LIC Includes internal customer process documents More powerful investigation on Process bottlenecks Quick analysis on failed jobs Operator Link back if no alias Forecast Model Plan Plan Graph view Better navigation capabilities More filtering possibilities List view External actor (TEP, ticketing) 10 10 JS Graph View Impact Graph View List critical jobs © 2014 IBM Corporation © 2014 IBM Corporation Business needs Self Service capability Ensure business user autonomy in triggering and monitoring business services Natural description, hide complexity of operations On-demand submission of business services from anywhere at anytime 11 © 2014 IBM Corporation Mobile Bus: Self-Service Management Feature Mobile (and web) interface to: Group cross-engines data by line of business Monitor overall LoB workload progresses Drill-down and perform recovery actions Value Limit the monitoring scope and focus to business relevant info Efficient problem determination and quick analysis Enhanced operations and LoB autonomy 12 12 © 2014 IBM Corporation Scenario 2: PREVENTING is much better than repairing How are we this year on our 99% SLA? Statistical view Simulate effect of change Data interface Action interface Proactive view See overall picture The statistics have been worsening for this group of job in the last 3 weeks. It corresponds to the installation of this library Quality metrics Risk assessment We have about 3 hours before the delay impacts us. 13 © 2014 IBM Corporation Map Business SLAs : Workload Service Assurance A complete solution with minimal impact Administration Allows identification of critical workload Automation Automation Operation 14 Calculates critical path to critical workload and keep it dynamically updated Takes autonomous remedial actions for lagging jobs in the critical path Gives a view of the critical end points and the possibility to understand how well workload is progressing to reach the critical milestone. Customer value Alignment of workload to business priorities Service Level management, automate operations and reduce costs Take in account historical metrics and indicators when forecasting expected completion of jobs Monitor the most current critical path Automate remedial actions as first reaction to risk Proactive alerting of users about potentially risk conditions © 2014 IBM Corporation Workload Service Assurance: Critical Path determination Automatic determination of critical path to critical jobs Through the network of internal and external 21:00 dependencies Path with minimum slack 1:00time Cannot be delayed without delaying the critical job 5:00 Dynamic adjustements: an alternate leg 6:00 may become critical Unexpected anomalous condition in the critical jobs predecessors Unplanned workload 15 © 2014 IBM Corporation Text Interfaces Some examples of IWA text interfaces ISPF panels – Panels to access all aspects of the product Batch Loader – Add, modify, and delete scheduling objects, make mass updates, import and export data SRSTAT, OPSTAT – Utilities to manipulate specific objects. PIF - API to manipulate all aspects of the product, relatively low level Batch Command Interface (BCIT) – API to manipulate single objects SOE – REXX set of functions to the development of small programs Composer – Add, modify, and delete scheduling objects, make mass updates, import and export data Conman – Monitor, change, and submit new work Datecalc, Jobinfo, Sendevent – utilities for specific tasks Parm/param - Set local variables on the agent 16 16 © 2014 IBM Corporation Streamlined Software Delivery Manage and Control your delivery lifecycle Rich integration leveraging linked data architecture and OSLC standards for integration 1) A critical job failed TWS Workflow 3) Evaluate impacts on the business caused by job failure Automation Automate the execution of unattended workloads Monitoring Availability and Performance monitoring 2) Notify operators through a Situation alert Business Impact Impact of failures on business operations (TBSM) 4) Open a service request ticket to fix the problem 5) Create a backup virtual environment to recover an HW failure Incident Management Provisioning services in the cloud SmartCloud Control Desk SmartCloud Provisioning & Orchestrator 17 © 2014 IBM Corporation Proactive monitoring & alert : Ws-Planning predict what will happen in the next production cycle identify impacts on the service which may be caused by any delays in processing send ALERTS in advance for any forecast of time deviation advance simulation of changes to the batch flow PREDICTIVE MONITORING Ws-Planning has the ability to capture in real time the effect of a delay on completion of all processes relevant to restarting a service or a business line. Ws-Planning allows to monitor and forecast at job or schedule level, or just a small number of macro-objects instead of all the individual processing units (while it is still possible to see every detail), ex.: Line Of Business: impact on the service for a single client Functional view: identification of application areas impacted Operations view: real time control of the overall flow and cost of the work. 18 © 2014 IBM Corporation Proactive monitoring & alert : Ws-Planning Technical View System SubSys MacroPha se LOB, Buiness view Phase Schedules Jobs 19 © 2014 IBM Corporation Proactive monitoring & alert : Ws-Planning Monitor and forecast Forecast Monitoring Time NOW The current time line divides what already executed(Real Time) from what is expected (Expected Time) 20 © 2014 IBM Corporation Proactive monitoring & alert : Ws-Planning Simulation Manually Change elapsed time Delete dependency Simulation: how the batch flow would change Add dependencies 21 © 2014 IBM Corporation Scenario 3: when you get rolling it’s time to OPTIMISE Statistical view Back tracking capability Proactive view Impact analysis Tight coupling with change mgmt Let me sign off to dismiss these 1500 useless jobs We’ve been working with the team generating the highest number of error per job. Their stats have improved by 60% Clear, actionable improvement steps We expect a 2 hours bump tomorrow to absorb an extra task 22 © 2014 IBM Corporation Batch schedule execution time reduction: RE-Engineering The Re-Engineering solution takes the user through a detailed analysis of the existing processes and proposes new optimal design of batch schedules and jobs. • • Reduction of the batch window and more efficient use of resources in automation of scheduling and batch processing. Fully automatic generation of new Jobs and batch schedules (TWS and others). It also promotes adherence to technical standards and rules: • backup/restore, • restart, • checkpoint, • temporary files, • use of GDGs, • report generation and condition code processing. • … 23 © 2014 IBM Corporation Batch schedule execution time reduction: RE-Engineering Re-Engineering – the flow of schedules optimization • Easy Re-Engineering: no changes to the existing jobs J01 J01 1h 1h J02 2h J02 J03 J04 2h J03 3h J05 3h J04 J05 4h 4h J06 5h J06 J07 24 6h J07 5h 6h © 2014 IBM Corporation Batch schedule execution time reduction: RE-Engineering Re-Engineering – the flow of schedules optimization • Deep Re-Engineering: max parallelism, change of the existing jobs J01 J01 1 1h J03 J02 E 2 J03 4 J04 2h J06 6 5 3h 4h 7 J09 2h J11 J12 S01 11 13 J13 2 3 12 14 15 J08 J10 1 10 J05 J07 9 8 J04 1h J02 3 S02 16 S03 5 S04 10 6 S05 7 4h 9 8 S06 3h 4 S07 11 S09 S08 13 S10 25 S11 15 12 14 S12 16 © 2014 IBM Corporation The hidden things that make the difference INSTALL AND ADMIN TIPS 26 © 2014 IBM Corporation DWC for distributed 8.6 Browsers Browsers TDWC ISC Browsers Browsers Browsers Browsers 27 9.2 z/OS Connector 9.2-8.3 z/OS Server 9.2+ DWC Historical DB © 2014 IBM Corporation DWC for distributed 9.2+ Browsers Browsers DWC 9.2-8.5 TWS MDM Browsers Browsers Browsers Browsers 28 TWS DDM TWS FTA © 2014 IBM Corporation DWC installation sequence • Installation Manager is the new framework • Four steps to install • • • • Install Installation Manager Install Websphere Application Server Install JazzSM profile and system Install DWC packet and zConnector packet • Can be installed in a totally silent mode • Configuration • Connector instances for z/OS systems • Engine instances for Dist and z/OS systems 29 © 2014 IBM Corporation DWC security setup • Done by Websphere since 8.3 • More advanced security repositories with later versions • LDAP • Unix PAM • • • • 30 Profiling by group Import – Export of dependencies Additional user mapping for the Self-Service part Since 9.1, full Websphere installation includes the administrative console. © 2014 IBM Corporation Ground perspective evolution THE SAAS CHANGE COMING 31 © 2014 IBM Corporation Workload Automation in a full Software as a Service Quick start solutions Key differentiator Drive business and IT workloads with IBM WA SaaS WA SaaS combines TWS+TWS for Apps on consumption basis, hosted by Softlayer + new off-the-shelf apps to map Business intelligence, ERP or IT processes. 32 © 2014 IBM Corporation Workload Automation in a full Software as a Service A deeper look at our SaaS offering Key points 1. Simplified user interfaces and access points 2. Quick start modeling of your processes – import Cron, Windows task scheduler, TWS workloads WA Dashboard 3. Support workloads with complex dependencies, auditing and SLA management Full interface for schedulers and operators Agents on-premises Secured with only outbound communication Simplified Interface For Application developers Hosted on Softlayer 33 © 2014 IBM Corporation The little things that make the difference USER TIPS 34 © 2014 IBM Corporation Interface improvements Right-click on objects for more options Direct submit from database to plan Additional doc for objects 35 © 2014 IBM Corporation Interface improvements (cont.) News updates Direct query in addition to tasks 36 © 2014 IBM Corporation Our customer needs 4 Application Development IT Schedulers and Operators Production Control Mgr Datacenter IT Director/CTO Chief architect Application developer Application manager Line of Business LOB owner CIO Customer needs Automate repetitive IT / business tasks Guarantee continuous availability Respect Service Level Agreements Integrate resources and tools Reduce application management Achieve business goals costs Reduce risks and costs Framework for development Self service capability for activity application rolling out IBM Workload Automation meet their needs with ... Central workload management Extended automation Simplified day-to-day tasks Simplified Cloud deployments & elastic scaling 37 Business integration hub Out-of-the-box support of applications Ticketing & Business Impact Integrations Agility to reduce costs Complementary Workload Automation solution Self service, no prerequisite skills © 2014 IBM Corporation Thank you https://www.ibmserviceengage.com/workload-automation/ 38 © 2014 IBM Corporation Workload Automation in a full Software as a Service Speed delivery of new services Key point Learn about and experiment with the latest IBM Workload Automation capabilities Set up a workload automation environment in minutes, without up-front investment Streamline the rollout of Business Applications Continuous delivery of capabilities and automated patching Automated provisioning of an instance (HA) Hosted on Softlayer 39 © 2014 IBM Corporation Workload Automation in a full Software as a Service Getting started Import Applications •Migrate your workload from IBM Workload Automation on-premise to SaaS •Migrate Cron jobs to WA SaaS •Migrate Windows task scheduler to WA SaaS Application Catalog Browse our ready-to-use applications : select, configure and run Users tasks access Application Lab Automate your workload with sequential processes (SaaS only) Dynamic Workload Console Automate your workload using advanced processes characteristics Self Service Catalog & Self Service Dashboard 40 © 2014 IBM Corporation