DevOps Technical Strategy and Roadmap Bruce Besch IBM Rational, DevOps Managing Consultant © 2014 IBM Corporation Software delivery is at the heart of today’s top technology trends Big Data Cloud Insights on new products by more efficiently interpreting massive quantities of data Demand for apps requires fast, scalable environments for dev and test, as well as production Social Business Instrumented Products Broader set of stakeholders collaborates to deliver continuous innovation and value Industry requirements demand faster response to regulations and standards, with traceability and quality Mobile Modern workforce expects constantly updated software to connect to enterprise systems Software delivery Intelligent/ Connected Systems Software component in smart products driving increased value and differentiation 2 A lack of continuous delivery impacts the entire business enterprise in the new reality of “Systems Of Interaction” Line-of-business Takes too long to introduce or make changes to mobile apps and services >70% >45% Systems of Interaction Systems of Engagement of budgets devoted to maintenance and operations 4-6 weeks Operations Rapid app releases impact system stability and compliance Continuous client experience Systems of Record Cloud-based Services CRM HR DB ERP MF iSeries Partner value chain to deliver even minor application changes to customers Development/Test Speed mismatch between faster moving front office and slower moving back office systems, delaying time to obtain feedback of customers experience production delays >50% of outsourced projects fail to meet objectives Suppliers Delivery in the context of agile 3 IBM DevOps Enterprise capability for continuous software delivery that enables clients to seize market opportunities and reduce time to customer feedback Continuous Business Planning Accelerate software delivery faster time to value Plan & Measure Continuous Monitoring Balance speed, cost, quality and risk increased capacity to innovate Reduce time to customer feedback improved customer experience Monitor & Optimize Continuous Customer Feedback and Optimization Continuous innovation, feedback and improvements Collaborative Development Develop & Test Release & Deploy Continuous Testing Continuous Release and Deployment 4 DevOps and Cloud adoption Automating for faster delivery with DevOps and cloud UC Deploy Traditional On-Premises Infrastructure as a Service Applications Applications Data UC Deploy Mid Config Man/Auto Data Platform as a Service JazzHub (SaaS) Applications Data Mid Config Mid Config Middleware Middleware O/S O/S O/S Virtualization Virtualization Virtualization Servers Servers Storage Storage Networking Networking Middleware Man/Auto Manual PureApplication System SmartCloud Orchestrator SoftLayer Codename: BlueMix Servers Storage Networking Customization; higher costs; slower time to value Standardization; lower costs; faster time to value 5 IBM DevOps Solution IBM’s DevOps solution is built on an open standards based platform and a set of services which enable clients to leverage open source and third party tools Rational Focal Point Rational Requirements Composer Line of Busine ss Rational Team Concert IBM UrbanCode Release IBM UrbanCode Deploy Jenkins SmartCloud Orchestrator IBM Pure Application System Rational Build Forge Rational Asset Manager Rational Quality Manager Rational Test Workbench Rational Test Virtualization Server Rational Development and Test Environment for System z InforSphere Optim Test Data Mgmt SmartCloud Application Performance Management 6 6 Investing in Release Automation … Introducing UrbanCode Enabling clients to more rapidly deliver mobile, cloud, big data and traditional applications with high quality and low risk Drive down cost Remove manual effort and wasted resource time with push button deployment processes Speed time to market Simple, graphical process designer, with built-in actions to quickly create deployment automation Reduce risk Robust configuration management, coordinated release processes, audits, and traceability IBM UrbanCode Deploy automates the deployment of applications, databases and configurations into development, test and production environments, helping to drive down cost, speed time to market with reduced risk. IBM UrbanCode Release is an intelligent collaboration release management solution that replaces error-prone manual spreadsheets and streamlines release activities for application and infrastructure changes. https://www.ibmdw.net/urbancode/ 7 Continuous Delivery Pipeline 8 Managing workloads across the lifecycle requires orchestration Data ComputeAvailability Domain Domain Monitoring Storage DomainDomain Orchestration Engine Network Domain IT Management Monitoring IT Asset Storage Management Domain Network Change Domain Management Web App DB Service Desk Provision Pattern Resource Orchestration Onboard, provision, manage CPU, Storage and Network Workload Orchestration Service Orchestration Workload aware placement, optimization and operation Manage the lifecycle of business applications 9 Managing workloads across the lifecycle requires orchestration F5 Load Balancer Tivoli Netcool Configuration Manager Juniper Firewall IT NetApp NAS Monitoring Management VMware Tivoli Productivity Domain Center (Sonas) Data PowerVM Availability Tivoli Storage Manager Domain KVM Amazon EC2 zVM SoftLayer Orchestration Engine Web App DB IBM EndPoint Manager software installation patch and compliance Chef server software installation Network Domain Tivoli Provisioning Manager Tivoli Workload Scheduler ervice SmartCloud Desk Control Desk Provision Pattern Over 200 IBM and industry patterns OpenStack IaaS WebSphere Virtual System Patterns DB2 PureApplication System Mobile Tivoli Service Automation Manager Business Intelligence SharePoint SQL Server Approval processing Scripting utilitities Email Database Java Web Services 10 Automating application deployment to cloud resources IBM UrbanCode Deploy UrbanCode Deploy World-Wide Banking Application war ddl IBM Cloud mq Application Component Environments DEV QA ... World-Wide Banking Application war Tomcat ddl MySQL PROD World-Wide Banking Application mq war JMS WebSphere Liberty Cloud Resources (DEV) ddl mq DB2 WSMB Pattern Parameters can be supplied by Properties from UC Deploy Cloud Resources (PROD) SmartCloud Orchestrator Public Clouds Hybrid IBM PureApplication System Private Clouds 11 Improve Delivery Lifecycle with Software Defined Environments Build Automation SCM Pull changes Publish build IBM PureApplication System SmartCloud Orchestrator Execute application deployment and manage settings across environments Environments Provision platform DEV DEV DEV DEV QA PROD Deploy early and often to ensure higher quality and faster releases using repeatable, reliable, and managed automation Patch/update Platform Config Management IBM Endpoint Manager 12 Reliable management of middleware configuration across environments Middleware Administrator -orApplication Developer Deployment Automation Developer 2 - Plugin Artifact Library 3 - Import 4 - Assemble 6 – Define Deployment Process 5 - Publish EAR 7 - Deploy WAS Configuration Template 7 - Deploy Exemplar WAS Cell 7 - Deploy WAR Cluster template DB Application Application Deployment Automation WAS Configuration Template Creation Dev QA Prod Application Environments 13 DevOps: Continuous Combining Testing continuous testing with Deployment automation and service virtualization for reducing time to market and improving quality Test Environments IBM UrbanCode Deploy integrated with IBM Rational Test Virtualization Server Deploy what is ready, virtualize the rest IBM Rational Test Workbench Continuously test in production-like env. SHUNRA Network n Virtualization Test using real world network conditions virtual components Databases Dev Internal Messages QA Third-party Services Simultaneously test across multiple test stages Dynamic Infrastructure 14 Smarter Mobile Quality Assessment IBM Mobile Quality Assurance services (beta) Addresses five key use cases, attacking pain points for all key users User Feedback Crash logs 4 Crash log reporting Bugs vs. Crashes Bugs LOB/Digital Marketer Developer 5 Sentiment Analysis Quality Dashboard with Sentiment Analysis 1 Over the air build distribution End Users Tester 2 In app bug reporting 3 In app user feedback Builds 15 Recent UrbanCode Deploy Improvements v6.0 and v6.0.1 Usability Improvements – Source configs = plugins – More multifunction lists and tagging – Comparison views New Process Configuration Options – Workflow capability: vertical integration container z/OS (mainframe) Support Integration with SoftLayer Improved SmartCloud Orchestrator integration WebSphere configuration 16 Recent UrbanCode Release Improvements v6.0 and v6.0.1 Rational Team Concert Integration – – – – – Change Management OSCL Integration Mapping RTC Delegated UI Dialogs Release Progression Release Impact Analyses Pipeline View Federated Deployment Dashboard 17 IBM UrbanCode Deploy – Plug-ins • • • 59 plug-ins from15 different vendors and open source organizations Broad range of plugins supported: • Application servers • Databases • Messaging platforms • Test automation • Issue tracking systems • Operating system services • Cloud platforms • Issue tracking • Even more… Plug-ins can be downloaded for free from https://www.ibmdw.net/urbancode/plugins/ 18 Future Directions © 2014 IBM Corporation Moving to open technologies Applications IBM UrbanCode Deploy Banking Application Application template Environments Application Lifecycle DEV TEST QA PROD IBM Cloud Orchestrator Banking Application Banking Application Infrastructure template Heat Orchestration Template (HOT) Heat Orchestration Template (HOT) OpenStack Heat IBM Platform Resource Scheduler OpenStack Heat IBM Platform Resource Scheduler Hardware Network Public Server Storage Dedicated Network Server Traditional IT Storage Private 20 Next generation pattern development and lifecycle management A full-stack engineering solution for designing, deploying, and managing environments Components Tool Cloud Pattern Designer HOT document editor & Environment lifecycle management tool HOT Heat Templates (HOT) Building Blocks Resources Executes on Organic environments Engine OpenStack Heat Version-aware Full-stack engineering Platforms Composable content Cloud agnostic 21 IBM DevOps Services (JazzHub) for Cloud Open, integrated rapid development experience that scales Planned Services Git hosting Store and manage the code for your application in the hosted Git repo. Integrated Development Environment Use built-in Web IDE, Eclipse, Visual Studio or leverage your tool of choice. Agile planning & tracking, team collaboration Easily share work and collaborate with team members. Mobile quality Improve mobile app quality through crash analytics, sentiment analysis, and feedback. Continuous Integration Continuously build, scan, and test code to improve quality and increase speed of delivery. Deployment automation Instantly deploy your applications. Performance monitoring Identify the early occurrence and root cause of performance issues, not just the symptoms, throughout the application lifecycle. Conduct code level diagnostics to identify bottlenecks and optimize application performance. 22 Globally distributed enterprise deployments Data Center B Data Center A Clustered High Availability Agents Clustered High Availability Relay Server Relay Server Load Balancer Load Balancer Agents Associated servers across sites Shared by servers Shared by servers DB DB CodeStation CodeStation Replicate deployment artifacts Synchronize data (e.g. process definition, security, templates) Awareness-only of other (e.g historical data) 23 Environment Change Management Configuration drift detection Compliant? Desired State What we want Compliant? Actual State Inventory What we believe exists X What is actually on the system 24 Expanding mobile delivery services Develop Deliver IDE Build SCM Request Build Rational Team Concert Deploy Built Artifacts Jazz Build Engine Use Application Run IBM UrbanCode Deploy Mobile Resource Android Native SDK Build Worklight IBM Worklight Server Planned Solution Automate deployment of mobile applications by interacting with mobile platforms and mobile SDKs Support for IBM Worklight (available today) Support for emulators/simulators in Apple XCode and Android SDK Support for mobile testing “deviceclouds”, e.g.: Appurify, Perfecto Mobile and DeviceAnywhere 25 Deployment automation of native mainframe applications IBM UrbanCode Deploy for z/OS Deploy Code Station on z/OS Test Environment – RD&T Application under test • Download build output from Code Station on z/OS • Deploy to z/OS or RD&T to test application changes Promote Value from planned unified solution • Accelerate delivery and reduces cycle time to develop/test multi-tier applications across heterogeneous environments and platforms • Reduce costs and eliminate delays for delivering mainframe applications • Minimize risk and improve productivity across disparate teams with cross-platform release planning 26 Summary Adopting DevOps with Plan & Measure Monitor & Optimize Cloud accelerates delivery Continuous innovation, feedback and improvements Develop & Test Release & Deploy IBM provides enterprise Cloud and DevOps solutions – – – – SmartCloud Orchestrator PureApplication System SoftLayer UrbanCode Public Clouds Private Clouds SmartCloud Orchestrator IBM PureApplication System We are investing for the future – Codename: BlueMix – JazzHub – DevOps Services – NextGen Pattern lifecycle management – DevOps for Mobile & Mainframe DevOps Services Java Session Mobile Cache DB 27