IBM zEnterprise System June, 2012 Jeffrey Frey IBM Fellow, System z Architecture and Design CTO, System z Platform © 2010 IBM Corporation zEnterprise: Integrated IT Infrastructure for Optimized Service Delivery zEnterprise Unified Resource Manager Integrated, dynamic, intelligent IBM zEnterprise™ 196 (z196) 2 resource management Workload-Aware Resource Optimization Enabled for Infrastructure as a Service zEnterprise BladeCenter Extension (zBX) Optimized to host large Selected IBM POWER7™ scale database, transaction, and mission critical applications The Most efficient platform for Large-scale Linux consolidation Capable of massive scale up blades and IBM System x® Blades* for AIX® , Linux, and Windows applications High performance optimizers and appliances to accelerate time to insight and reduce cost Integrated high performance private network © 2010 IBM Corporation The Netezza TwinFin™ Appliance Disk Enclosures SMP Hosts Snippet Blades™ (S-Blades™) Slice of User Data Swap and Mirror partitions High speed data streaming SQL Compiler Query Plan Optimize Admin Processor & streaming DB logic High-performance database engine streaming joins, aggregations, sorts, etc. © 2011 IBM Corporation The Netezza AMPP™ Architecture FPGA CPU Advanced Analytics Memory BI FPGA CPU Host Hosts Memory ETL FPGA CPU Loader Memory Disk Enclosures S-Blades™ Network Fabric Applications Netezza Appliance © 2011 IBM Corporation Now expandable to 960 cores and 1.28 petabytes 1 10 ....... TF3 TF6 TF12 TF24 TF36 TF48 TF72 TF96 TF120 Cabinets 1/4 1/2 1 2 3 4 6 8 10 Processing Units 24 48 96 192 288 384 576 768 960 Capacity (TB) 8 16 32 64 96 128 192 256 320 Effective Capacity (TB)* 32 64 128 256 384 512 768 1024 1280 Accelerator Platforms Predictable, Linear Scalability throughout entire family Capacity = User Data space Effective Capacity = User Data Space with compression Low Latency, High Capacity Update *: 4X compression assumed © 2011 IBM Corporation DB2 Analytics Accelerator Accelerating decisions to the speed of business Blending System z and Netezza technologies to deliver unparalleled, mixed workload performance for complex analytic Get more insight from your data • Fast, predictable response times for “right-time” analysis • Accelerate analytic query response times • Improve price/performance for analytic workloads • Minimize the need to create data marts for performance • Highly secure environment for sensitive data analysis • Transparent to the application business needs. Low Latency, High Capacity Update © 2011 IBM Corporation Performance & Savings DB2 Only Query Query 1 Query 2 Query 3 Query 4 Query 5 Query 6 Query 7 Query 8 Query 9 Total Total Rows Rows Reviewed Returned 2,813,571 853,320 2,813,571 585,780 8,260,214 274 2,813,571 601,197 3,422,765 508 4,290,648 165 361,521 58,236 3,425.29 724 4,130,107 137 DB2 with IDAA Times Faster Queries run faster • Save CPU resources Hours Sec(s) 2:39 9,540 2:16 8,220 1:16 4,560 1:08 4,080 0:57 4,080 0:53 3,180 0:51 3,120 0:44 2,640 0:42 2,520 Hours Sec(s) 0.0 5 0.0 5 0.0 6 0.0 5 0.0 70 0.0 6 0.0 4 0.0 2 0.1 193 1,908 1,644 760 816 58 530 780 1,320 13 • People time • Business opportunities Actual customer results, October 2011 DB2 Analytics Accelerator: “we had this up and running in days with queries that ran over 1000 times faster” DB2 Analytics Accelerator: “we expect ROI in less than 4 months” Advance to 32 minute mark for DB2 Analytics Accelerator section of keynote Accelerating decisions to the speed of business 7 © 2011 IBM Corporation Fit The Solution To The Workload – Access to all Data Business Analytics / ODS Complex queries against a data warehouse Read only Star schema design often used to speed up queries Different modes of operation OLTP Transactions against operational data Reads and writes Normalized schema design to eliminate redundancy Multiple user throughput operation Tightly integrated solution optimized for workloads Simplification Single entry point to the true data High fidelity data Performance IBM DB2 Analytics Accelerator (IDAA) DB2 for z/OS ODS members DB2 for z/OS OLTP members © 2011 IBM Corporation Cloud Computing Flexible Service Delivery and Consumption • Delivers select set of standardized business process, application, software platform, and/or infrastructure services on a flexible price per use basis • Service Providers and Service Consumers Cloud Services Cloud Computing Model .…Standardization, capital preservation, flexibility and time to deploy ORGANIZATION • Access by subscription • Drives efficiency, standardization and best practices while retaining greater customization and control • Formal Service Lifecycle approach .… Customization, efficiency, availability, resiliency, security and privacy CULTURE GOVERNANCE ....service sourcing and service value 9 © 2010 IBM Corporation Service Lifecycle Subscribe to Service Request a service SLA Negotiation Service Personalization “Sign“ Contract Offer Service Register Services Add to Service Catalog Service Design & Creation Service Composition Resource Modeling Tools Service Level Choices Topologies, Best Practices, Management Templates 10 Deploy Service Request Driven Provisioning Management Agents and Best Practices Application / Service On Boarding Self-service interface Manage Operation of Service Service Composition and Context Monitoring, Reporting and Optimization Operational Control Change Management Security Management Event handling Process Management Metering and Billing Terminate Service Controlled Clean-up Taxonomy Service Management & Orchestration Self Service Portal Subscriber Mgmt Application Management APP APP SaaS APP APP APP APP Service Management Placement Advice Middleware Resource Provisioning OS and Middleware Management Image Management Billing PaaS z/OS, zLinux, … AIX x86 Linux Monitoring SLA Management Virtual Servers, Storage, Network Service Catalog Workload-Aware Optimization Infrastructure Virtualization Management Management Hardware Management 11 IaaS Firmware and Hypervisors Server, Storage, Network, Accelerators, Appliances © 2010 IBM Corporation zEnterprise System Workload Resource Groups: SLA Mgmt and Reporting (Deployment, Performance, Availability, Security, Energy) pHyp pHyp pHyp pHyp pHyp pHyp pHyp Cell DWA Data Power DWA xHyp xHyp xHyp xHyp xHyp ISS ISS DP DP Cell AIX AIX AIX AIX AIXAIX AIX AIX AIX AIX AIX AIXAIX AIX AIX AIX AIX AIXAIX AIX AIX Linux Power Linux Linux Linux Linux Linux Linux Windows Linux Linux Linux Linux Linux Linux Linux Linux zHyp PR/SM Linux Linux zOS Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS Virtual Machine HMC (with Unified Resource Management) x86 Z CPU, Memory and IO AMM AMM SE SE z Blade Extension z Blade Extension AMM z Blade Extension Private Data Network (IEDN) 12 © 2010 IBM Corporation What is a zEnterprise Ensemble? Power AIX AIX xHyp xHyp xHyp xHyp xHyp pHyp pHyp pHyp pHyp pHyp Z CPU, Memory and IO SE SE z Blade Extension z Blade Extension z Blade Extension AMM AMM AMM AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS Linux pHyp pHyp pHyp pHyp pHyp z Blade Extension z Blade Extension z Blade Extension AMM AMM AMM Power AIX AIX xHyp xHyp xHyp xHyp xHyp pHyp pHyp pHyp pHyp pHyp ISS ISS DP ISS DP Cell DP Cell DWA HPC DWA DWA z/VM PR/SM AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS x86 Z CPU, Memory and IO SE SE z Blade Extension z Blade Extension z Blade Extension AMM AMM AMM xHyp xHyp xHyp xHyp xHyp AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX Linux Power pHyp pHyp pHyp pHyp pHyp ISS ISS DP ISS DP Cell DP Cell DWA HPC DWA DWA z/VM PR/SM Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Virtual Machine zOS Linux x86 Virtual Machine zOS Virtual Resource Management and Optimization xHyp xHyp xHyp xHyp xHyp SE SE Virtual Machine zOS Implements well-defined external interface to Data Center Service Management functions Power Z CPU, Memory and IO Virtual Machine zOS Integrated Advanced Virtualization Management z/VM PR/SM Virtual Machine zOS zEnterprise nodes are deployed within “synchronous” distances on L2 Network zHMC - Ensemble Manager x86 ISS ISS DP ISS DP Cell DP Cell DWA HPC DWA DWA A zEnterprise Node is a single zCEC with 0..4 racks with up to 1..2 blade centers per rack Ensemble defines the scope of a zManager management domain ISS ISS DP ISS DP Cell DP Cell DWA HPC DWA DWA z/VM PR/SM AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS A zEnterprise Ensemble is a collection of 1..8 zEnterprise Nodes managed as a single virtualized pool of server resources Virtual Machine zOS Virtual Machine zOS x86 Z CPU, Memory and IO SE SE 13 z Blade Extension z Blade Extension z Blade Extension AMM AMM AMM © 2010 IBM Corporation Customer Managed Management Network TOR Switches z Frame zBX Frames Intra-Node Management Network Mgt Interfaces Intra-Ensemble Data Network zEnterprise Node Customer managed Data Networks 14 OSM & OSX OSAs BC Chassis OSD OSAs © 2010 IBM Corporation RDMA Aimed at providing very low latency/minimal CPU overhead interconnect between virtual servers within zEnterprise Utilizes RoCE (RDMA over Converged Ethernet) New protocol that allows existing TCP applications to transparently benefit from RDMA for transferring data Builds upon reliable write access to a remote host’s memory in a controlled manner 15 © 2010 IBM Corporation Dynamic Provisioning Deploy a Virtual Machine Image ► The Image meta-data is used to create VM container, allocating the required server, storage, and network resources ► The bootable image is copied to the selected virtual host system. ► The virtual machine is started from the bootable disk image. Capture a Virtual Machine Image Image Library SW SW OS SW OS SW meta-data OS OS meta-data meta-data meta-data ► The bootable disk image is copied into the image library. ► Image meta-data describing the Virtual Infrastructure is captured and included as part of the image. SW OS Virtual Machine Virtual Machine meta-data Compute 16 Memory IO / Network SW SW OS SW OS © 2010 IBM Corporation Virtual Resource Optimizations SW SW SW OS OS OS Virtual Machine Virtual Machine Virtual Machine Virtual Machine Virtualization Virtualization Compute Memory Compute IO / Network SW OS SW OS Memory IO / Network SW OS Dynamically adjust virtual machines resource allocations. ► ► Allowing unallocated resources to be used by a virtual machine. Allowing resource allocation adjustments to be made between virtual machines Virtual server mobility between host systems. ► ► ► 17 Allocate resources on the target host. Move the virtual machine in-memory state to target host. De-allocating resources on the source host. © 2010 IBM Corporation Virtual Machine Placement Intelligence What is the most appropriate virtual host within the ensemble to run a given virtual machine image? Mobility – When deploying – When moving – When restarting Need to consider… – Constraints (Configuration, Licensing..) – Optimizations (Performance, Availability, Energy, Isolation) Placement Advisors help to provide optimized placement for the virtual machines within the Ensemble 18 Optimized for …. • Availability • Performance • Energy © 2010 IBM Corporation zManager Interface Resource Discovery Monitoring and Events Resource Provisioning zManager Interfaces Automation zHMC - Ensemble Manager Security Deployment and Mobility Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS z/VM Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux x86 xHyp xHyp xHyp xHyp xHyp AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX Power pHyp pHyp pHyp pHyp pHyp AMM AMM AMM ISS ISS DP ISS DP Cell DP Cell DWA HPC DWA DWA Power pHyp pHyp pHyp pHyp pHyp AMM AMM AMM AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX z Blade Extension z Blade Extension z Blade Extension Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Service Level Policy Linux Linux x86 xHyp xHyp xHyp xHyp xHyp z Blade Extension z Blade Extension z Blade Extension ISS ISS DP ISS DP Cell DP Cell DWA HPC DWA DWA Power pHyp pHyp pHyp pHyp pHyp AMM AMM AMM AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX Linux Linux x86 xHyp xHyp xHyp xHyp xHyp z Blade Extension z Blade Extension z Blade Extension Power pHyp pHyp pHyp pHyp pHyp AMM AMM AMM ISS ISS DP ISS DP Cell DP Cell DWA HPC DWA DWA 19 x86 xHyp xHyp xHyp xHyp xHyp z Blade Extension z Blade Extension z Blade Extension AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Virtual Machine zOS Virtual Machine zOS Linux Linux Placement Advice Virtual Machine zOS PR/SM Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux z/VM z/VM z/VM Linux Virtual Machine zOS Z CPU, Memory and IO Linux Virtual Machine zOS SE SE SE SE Virtual Machine zOS Virtual Machine zOS PR/SM Virtual Machine zOS Z CPU, Memory and IO Linux Virtual Machine zOS PR/SM SE SE Virtual Machine zOS Z CPU, Memory and IO Virtual Machine zOS PR/SM SE SE Z CPU, Memory and IO Virtual Machine zOS ISS ISS DP ISS DP Cell DP Cell DWA HPC DWA DWA © 2010 IBM Corporation zManager Interface API is a new implementation in the HMC – New API includes existing SNMP/CIM function plus new Unified Resource Manager capabilities – HMC SNMP and CIM interfaces not being extended with Unified Resource Manager function – Existing SNMP and CIM capabilities remain in place and supported Architecture/design based on current industry design practices – Requests and responses structured as RESTful web services – Status and property change notifications delivered via JMS – HMC provides an embedded JMS broker configured to support API-specific use only – JSON Payloads – Modern scripting languages (e.g., Java, Perl, Python) have HTTP support libraries TCP/IP Sockets/HTTP is underlying network transport with SSL for connection security Fully documented and supported for customer and third-party use 20 © 2010 IBM Corporation Linked Pages 21 © 2010 IBM Corporation IBM System x Blade Support HX5 with Westmere processor – – – – – – – – Intel 8-core Processor 2 Processor sockets 2.13 GHz @ 105W 16 DIMM 1066 Mhz memory Different memory configurations up to 256GB Two internal 50GB SSDs 8Gb Fibre Channel 10 GbE Ethernet Hypervisor is KVM – – – Kernel-based Virtual Machine Implemented as Linux device driver Requires a hosting Linux system/distribution (Selected RHEV-H) Operating System certifications: Linux (RHEL and SLES) and Windows OS Support (64 bit only): – – – RHEL 5.5, SLES 11 (SP1), Additional versions to follow Windows Server 2008 (SP2) for Data Center Windows Server 2008 R2 for Data Center Provide KVM virtio drivers from RedHat for all supported versions/editions 22 © 2010 IBM Corporation Encrypted and Signed SOAP/HTTP In-the-clear SOAP/HTTP Linux Linux Linux Virtual Machine zOS Virtual Machine zOS DataPower Integration SOAP z/VM SOAP AIX AIX AIX PR/SM Linux Linux Linux SOAP pHyp Cobol/ MQ Appl Clients AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX AIX xHyp xHyp xHyp xHyp xHyp pHyp pHyp pHyp pHyp pHyp Linux Z CPU, Memory and IO SE SE 23 z Blade Extension z Blade Extension z Blade Extension AMM AMM AMM ISS ISS DP ISS DP Cell DP Cell DWA HPC DWA DWA Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux Linux PR/SM Power Linux Linux Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS Virtual Machine zOS x86 z/VM xHyp Malicious SOAP/HTTP Deep-content routing and data aggregation SOA Stack Acceleration Application-layer security and threat protection Protocol and message bridging Blade Hardware Management Energy Monitoring and Management of DP Blades DP Firmware Load and Update HMC Console Integration PPM Assisted Dynamic Load Balancing (Future) IEDN Virtual Network Provisioning Monitoring and Reporting DP Failure Recovery and Restart © 2010 IBM Corporation IBM zEnterprise System The Value begins at the heart of z196……. 40% 30% 60% Improvement for traditional z/OS workloads Improvement in CPU intensive workloads via compiler enhancements Total capacity improvement zEnterprise 196 (z196) Machine Type: 2817 Models: M15, M32, M49, M66, M80 Technology and Performance Enhanced Availability and Serviceability 1 to 80 configurable for client use Workload Optimized Simplified Management IFL, zIIP, zAAP, ICFs and optional SAPs Dynamic Energy optimized Up to 3 TB RAIM memory 15 subcapacity settings Cryptographic enhancements Optional water cooling and/or HV DC Power Upgradeable from z10 EC and z9 EC 24 IBM Confidential © 2010 IBM Corporation IBM zEnterprise System …… and the value extends to heterogeneous workloads …… IBM zEnterprise BladeCenter Extension (zBX) Machine Type: 2458 – Model 002 Integrated IBM Certified Components driven by System z order – Standard parts – TOR switch, BladeCenter Chassis, Power Distribution Units, Optional Acoustic Panels System z support – Problem reporting, hardware and firmware updates Optimizers IBM Smart Analytics Optimizer IBM WebSphere DataPower (XI50z for zEnterprise) Select IBM Blades IBM BladeCenter PS701 Express IBM BladeCenter HX5 7873 Expanding operating system support for z196 – AIX on POWER, Linux, and Windows on System x One to four – 42u racks – capacity for 112 blades Simplified management – Improved time to implement new applications – Central point of management for heterogeneous workloads – No change to applications No MIPS/MSU rating … managed by the Configured for high availability Integrated 10Gbe data network Optional rear door heat exchanger zEnterprise Unified Resource Manager 25 © 2010 IBM Corporation zEnterprise technology designed for small and mid-sized businesses The Value Begins At the Heart with the z114 … Up to zEnterprise 114 (z114) Machine Type: 2818 2 Models: M05 & M10 New technology in a new package ► ► ► ► ► ► Improved Platform Economics ► ► ► ► 26 Modular 2 drawer design for lower cost of entry Granularity for right-sizing your system Additional Scale for consolidation and growth Improved data center efficiency Same Qualities of Service as the z196 Hybrid enabled to drive workload expansion and integration New Software Curve Lower Hardware Maintenance Lower specialty engine and memory prices Upgradeability for investment protection 18% Up to an ADDITIONAL 25% Up to Scales From Improvement for traditional z/OS workloads 1 Improvement in CPU intensive workloads via compiler enhancements2 12% Total capacity improvement 1 26 - 3100 MIPS Up to 130 available capacity settings From 1-10 configurable cores for client use includes CPs, IFL, zIIP, zAAP, and ICFs From 0-2 IBM provided spare cores Up to 256 GB RAIM fault tolerant memory Fully Upgradeable from the IBM System z10 Business Class™ (z10 BC) & IBM System z9® Business Class (z9 BC); and to the z196 M15 © 2011 IBM Corporation