FreyMarist2

advertisement
IBM zEnterprise System
June, 2012
Jeffrey Frey
IBM Fellow, System z Architecture and Design
CTO, System z Platform
© 2010 IBM Corporation
zEnterprise:
Integrated IT Infrastructure for Optimized Service Delivery
zEnterprise Unified Resource Manager
 Integrated, dynamic, intelligent
IBM zEnterprise™ 196 (z196)
2
resource management
 Workload-Aware Resource
Optimization
 Enabled for Infrastructure as a
Service
zEnterprise BladeCenter
Extension (zBX)
 Optimized to host large
 Selected IBM POWER7™
scale database,
transaction, and mission
critical applications
 The Most efficient
platform for Large-scale
Linux consolidation
 Capable of massive
scale up
blades and IBM System x®
Blades* for AIX® , Linux,
and Windows applications
 High performance
optimizers and appliances
to accelerate time to
insight and reduce cost
 Integrated high
performance private
network
© 2010 IBM Corporation
The Netezza TwinFin™ Appliance
Disk Enclosures
SMP Hosts
Snippet
Blades™
(S-Blades™)
Slice of User Data
Swap and Mirror partitions
High speed data streaming
SQL Compiler
Query Plan
Optimize
Admin
Processor &
streaming DB logic
High-performance database
engine streaming joins,
aggregations, sorts, etc.
© 2011 IBM Corporation
The Netezza AMPP™ Architecture
FPGA
CPU
Advanced
Analytics
Memory
BI
FPGA
CPU
Host
Hosts
Memory
ETL
FPGA
CPU
Loader
Memory
Disk
Enclosures
S-Blades™
Network
Fabric
Applications
Netezza Appliance
© 2011 IBM Corporation
Now expandable to 960 cores and 1.28 petabytes
1
10
.......
TF3
TF6
TF12
TF24
TF36
TF48
TF72
TF96
TF120
Cabinets
1/4
1/2
1
2
3
4
6
8
10
Processing
Units
24
48
96
192
288
384
576
768
960
Capacity
(TB)
8
16
32
64
96
128
192
256
320
Effective
Capacity
(TB)*
32
64
128
256
384
512
768
1024
1280
Accelerator Platforms
Predictable, Linear Scalability throughout entire family
Capacity
= User Data space
Effective Capacity = User Data Space with compression
Low Latency, High Capacity Update
*: 4X compression assumed
© 2011 IBM Corporation
DB2 Analytics Accelerator
Accelerating decisions to the speed of business
Blending System z and Netezza
technologies to deliver unparalleled, mixed
workload performance for complex analytic
Get more insight from your data
•
Fast, predictable response times
for “right-time” analysis
•
Accelerate analytic query
response times
•
Improve price/performance for
analytic workloads
•
Minimize the need to create data
marts for performance
•
Highly secure environment for
sensitive data analysis
•
Transparent to the application
business needs.
Low Latency, High Capacity Update
© 2011 IBM Corporation
Performance & Savings
DB2 Only
Query
Query 1
Query 2
Query 3
Query 4
Query 5
Query 6
Query 7
Query 8
Query 9
Total
Total
Rows
Rows
Reviewed Returned
2,813,571
853,320
2,813,571
585,780
8,260,214
274
2,813,571
601,197
3,422,765
508
4,290,648
165
361,521
58,236
3,425.29
724
4,130,107
137
DB2 with
IDAA
Times
Faster
Queries run faster
• Save CPU resources
Hours Sec(s)
2:39 9,540
2:16 8,220
1:16 4,560
1:08 4,080
0:57 4,080
0:53 3,180
0:51 3,120
0:44 2,640
0:42 2,520
Hours Sec(s)
0.0
5
0.0
5
0.0
6
0.0
5
0.0
70
0.0
6
0.0
4
0.0
2
0.1
193
1,908
1,644
760
816
58
530
780
1,320
13
• People time
• Business opportunities
Actual customer results, October 2011
DB2 Analytics Accelerator: “we had this up and
running in days with queries that ran over 1000
times faster”
DB2 Analytics Accelerator: “we expect ROI in
less than 4 months”
Advance to 32 minute mark for DB2
Analytics Accelerator section of keynote
Accelerating decisions to the speed of business
7
© 2011 IBM Corporation
Fit The Solution To The Workload – Access to all Data
Business Analytics / ODS

Complex queries against a data warehouse
 Read only
 Star schema design often used to speed up queries
 Different modes of operation
OLTP
Transactions against
operational data
Reads and writes
Normalized schema design to
eliminate redundancy
Multiple user throughput
operation
Tightly integrated solution optimized for workloads
Simplification
Single entry point to the true data
High fidelity data
Performance
IBM DB2 Analytics Accelerator (IDAA)
DB2 for z/OS ODS members
DB2 for z/OS OLTP
members
© 2011 IBM Corporation
Cloud Computing
Flexible Service Delivery and Consumption
• Delivers select set of
standardized business
process, application, software
platform, and/or infrastructure
services on a flexible price
per use basis
• Service Providers and
Service Consumers
Cloud Services
Cloud Computing
Model
.…Standardization, capital
preservation, flexibility and
time to deploy
ORGANIZATION
• Access by subscription
• Drives efficiency,
standardization and best
practices while retaining
greater customization
and control
• Formal Service Lifecycle
approach
.… Customization, efficiency,
availability, resiliency,
security and privacy
CULTURE
GOVERNANCE
....service sourcing and service value
9
© 2010 IBM Corporation
Service Lifecycle
Subscribe to Service
 Request a service
 SLA Negotiation
 Service Personalization
 “Sign“ Contract
Offer Service
 Register Services
 Add to Service Catalog
Service Design & Creation
 Service Composition
 Resource Modeling Tools
 Service Level Choices
 Topologies, Best Practices,
Management Templates
10
Deploy Service
 Request Driven Provisioning
 Management Agents and Best Practices
 Application / Service On Boarding
 Self-service interface
Manage Operation of Service
 Service Composition and
Context
 Monitoring, Reporting and
Optimization
 Operational Control
 Change Management
 Security Management
 Event handling
 Process Management
 Metering and Billing
Terminate Service
 Controlled Clean-up
Taxonomy
Service Management
& Orchestration
Self Service Portal
Subscriber Mgmt
Application
Management
APP
APP
SaaS
APP
APP
APP
APP
Service Management
Placement Advice
Middleware
Resource Provisioning
OS and
Middleware
Management
Image Management
Billing
PaaS
z/OS, zLinux, …
AIX
x86 Linux
Monitoring
SLA Management
Virtual Servers, Storage, Network
Service Catalog
Workload-Aware Optimization
Infrastructure
Virtualization
Management
Management
Hardware Management
11
IaaS
Firmware and Hypervisors
Server, Storage, Network, Accelerators, Appliances
© 2010 IBM Corporation
zEnterprise System
Workload Resource Groups: SLA Mgmt and Reporting (Deployment, Performance, Availability, Security, Energy)
pHyp
pHyp
pHyp
pHyp
pHyp
pHyp
pHyp
Cell
DWA
Data Power
DWA
xHyp
xHyp
xHyp
xHyp
xHyp
ISS
ISS
DP
DP
Cell
AIX
AIX
AIX
AIX
AIXAIX
AIX AIX
AIX AIX AIX
AIXAIX
AIX AIX
AIX AIX
AIXAIX
AIX
AIX
Linux
Power
Linux
Linux
Linux
Linux
Linux
Linux
Windows
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
zHyp
PR/SM
Linux
Linux
zOS
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
HMC (with Unified Resource Management)
x86
Z CPU, Memory and IO
AMM
AMM
SE
SE
z Blade Extension
z Blade Extension
AMM
z Blade Extension
Private Data Network (IEDN)
12
© 2010 IBM Corporation
What is a zEnterprise Ensemble?
Power
AIX
AIX
xHyp
xHyp
xHyp
xHyp
xHyp
pHyp
pHyp
pHyp
pHyp
pHyp
Z CPU, Memory and IO
SE
SE
z Blade Extension
z Blade Extension
z Blade Extension
AMM
AMM
AMM
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
Linux
pHyp
pHyp
pHyp
pHyp
pHyp
z Blade Extension
z Blade Extension
z Blade Extension
AMM
AMM
AMM
Power
AIX
AIX
xHyp
xHyp
xHyp
xHyp
xHyp
pHyp
pHyp
pHyp
pHyp
pHyp
ISS
ISS
DP
ISS
DP
Cell
DP
Cell
DWA
HPC
DWA
DWA
z/VM
PR/SM
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
x86
Z CPU, Memory and IO
SE
SE
z Blade Extension
z Blade Extension
z Blade Extension
AMM
AMM
AMM
xHyp
xHyp
xHyp
xHyp
xHyp
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
Linux
Power
pHyp
pHyp
pHyp
pHyp
pHyp
ISS
ISS
DP
ISS
DP
Cell
DP
Cell
DWA
HPC
DWA
DWA
z/VM
PR/SM
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Virtual Machine
zOS
Linux
x86
Virtual Machine
zOS
 Virtual Resource Management and
Optimization
xHyp
xHyp
xHyp
xHyp
xHyp
SE
SE
Virtual Machine
zOS
 Implements well-defined external interface to
Data Center Service Management functions
Power
Z CPU, Memory and IO
Virtual Machine
zOS
 Integrated Advanced Virtualization
Management
z/VM
PR/SM
Virtual Machine
zOS
 zEnterprise nodes are deployed within
“synchronous” distances on L2 Network
zHMC - Ensemble Manager
x86
ISS
ISS
DP
ISS
DP
Cell
DP
Cell
DWA
HPC
DWA
DWA
 A zEnterprise Node is a single zCEC with 0..4
racks with up to 1..2 blade centers per rack
 Ensemble defines the scope of a zManager
management domain
ISS
ISS
DP
ISS
DP
Cell
DP
Cell
DWA
HPC
DWA
DWA
z/VM
PR/SM
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
 A zEnterprise Ensemble is a collection of 1..8
zEnterprise Nodes managed as a single
virtualized pool of server resources
Virtual Machine
zOS
Virtual Machine
zOS
x86
Z CPU, Memory and IO
SE
SE
13
z Blade Extension
z Blade Extension
z Blade Extension
AMM
AMM
AMM
© 2010 IBM Corporation
Customer Managed
Management Network
TOR
Switches
z Frame
zBX Frames
Intra-Node
Management
Network
Mgt Interfaces
Intra-Ensemble
Data Network
zEnterprise Node
Customer managed
Data Networks
14
OSM & OSX
OSAs
BC
Chassis
OSD OSAs
© 2010 IBM Corporation
RDMA
 Aimed at providing very low latency/minimal CPU overhead interconnect between virtual
servers within zEnterprise
 Utilizes RoCE (RDMA over Converged Ethernet)
 New protocol that allows existing TCP applications to transparently benefit from RDMA
for transferring data
 Builds upon reliable write access to a remote host’s memory in a controlled manner
15
© 2010 IBM Corporation
Dynamic Provisioning
 Deploy a Virtual Machine Image
►
The Image meta-data is used to create
VM container, allocating the required
server, storage, and network resources
►
The bootable image is copied to the
selected virtual host system.
►
The virtual machine is started from the
bootable disk image.
 Capture a Virtual Machine Image
Image Library
SW
SW
OS
SW
OS SW
meta-data OS
OS
meta-data
meta-data
meta-data
►
The bootable disk image is copied into
the image library.
►
Image meta-data describing the Virtual
Infrastructure is captured and included
as part of the image.
SW
OS
Virtual Machine
Virtual Machine
meta-data
Compute
16
Memory
IO / Network
SW
SW
OS
SW
OS
© 2010 IBM Corporation
Virtual Resource Optimizations
SW
SW
SW
OS
OS
OS
Virtual Machine
Virtual Machine
Virtual Machine
Virtual Machine
Virtualization
Virtualization
Compute
Memory
Compute
IO / Network
SW
OS
SW
OS
Memory
IO / Network
SW
OS
 Dynamically adjust virtual machines resource allocations.
►
►
Allowing unallocated resources to be used by a virtual machine.
Allowing resource allocation adjustments to be made between virtual machines
 Virtual server mobility between host systems.
►
►
►
17
Allocate resources on the target host.
Move the virtual machine in-memory state to target host.
De-allocating resources on the source host.
© 2010 IBM Corporation
Virtual Machine Placement Intelligence
 What is the most appropriate virtual
host within the ensemble to run a given
virtual machine image?
Mobility
– When deploying
– When moving
– When restarting
 Need to consider…
– Constraints (Configuration, Licensing..)
– Optimizations (Performance,
Availability, Energy, Isolation)
 Placement Advisors help to provide
optimized placement for the virtual
machines within the Ensemble
18
Optimized for ….
• Availability
• Performance
• Energy
© 2010 IBM Corporation
zManager Interface
 Resource Discovery
 Monitoring and Events
 Resource Provisioning
zManager Interfaces
 Automation
zHMC - Ensemble Manager
 Security
 Deployment and Mobility
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
z/VM
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
x86
xHyp
xHyp
xHyp
xHyp
xHyp
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
Power
pHyp
pHyp
pHyp
pHyp
pHyp
AMM
AMM
AMM
ISS
ISS
DP
ISS
DP
Cell
DP
Cell
DWA
HPC
DWA
DWA
Power
pHyp
pHyp
pHyp
pHyp
pHyp
AMM
AMM
AMM
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
z Blade Extension
z Blade Extension
z Blade Extension
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
 Service Level Policy
Linux
Linux
x86
xHyp
xHyp
xHyp
xHyp
xHyp
z Blade Extension
z Blade Extension
z Blade Extension
ISS
ISS
DP
ISS
DP
Cell
DP
Cell
DWA
HPC
DWA
DWA
Power
pHyp
pHyp
pHyp
pHyp
pHyp
AMM
AMM
AMM
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
Linux
Linux
x86
xHyp
xHyp
xHyp
xHyp
xHyp
z Blade Extension
z Blade Extension
z Blade Extension
Power
pHyp
pHyp
pHyp
pHyp
pHyp
AMM
AMM
AMM
ISS
ISS
DP
ISS
DP
Cell
DP
Cell
DWA
HPC
DWA
DWA
19
x86
xHyp
xHyp
xHyp
xHyp
xHyp
z Blade Extension
z Blade Extension
z Blade Extension
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Virtual Machine
zOS
Virtual Machine
zOS
Linux
Linux
 Placement Advice
Virtual Machine
zOS
PR/SM
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
z/VM
z/VM
z/VM
Linux
Virtual Machine
zOS
Z CPU, Memory and IO
Linux
Virtual Machine
zOS
SE
SE
SE
SE
Virtual Machine
zOS
Virtual Machine
zOS
PR/SM
Virtual Machine
zOS
Z CPU, Memory and IO
Linux
Virtual Machine
zOS
PR/SM
SE
SE
Virtual Machine
zOS
Z CPU, Memory and IO
Virtual Machine
zOS
PR/SM
SE
SE
Z CPU, Memory and IO
Virtual Machine
zOS
ISS
ISS
DP
ISS
DP
Cell
DP
Cell
DWA
HPC
DWA
DWA
© 2010 IBM Corporation
zManager Interface
 API is a new implementation in the HMC
– New API includes existing SNMP/CIM function plus new Unified Resource Manager
capabilities
– HMC SNMP and CIM interfaces not being extended with Unified Resource Manager
function
– Existing SNMP and CIM capabilities remain in place and supported
 Architecture/design based on current industry design practices
– Requests and responses structured as RESTful web services
– Status and property change notifications delivered via JMS
– HMC provides an embedded JMS broker configured to support API-specific use only
– JSON Payloads
– Modern scripting languages (e.g., Java, Perl, Python) have HTTP support libraries
 TCP/IP Sockets/HTTP is underlying network transport with SSL for connection security
 Fully documented and supported for customer and third-party use
20
© 2010 IBM Corporation
Linked Pages
21
© 2010 IBM Corporation
IBM System x Blade Support
 HX5 with Westmere processor
–
–
–
–
–
–
–
–
Intel 8-core Processor
2 Processor sockets
2.13 GHz @ 105W
16 DIMM 1066 Mhz memory
Different memory configurations up to 256GB
Two internal 50GB SSDs
8Gb Fibre Channel
10 GbE Ethernet
 Hypervisor is KVM
–
–
–
Kernel-based Virtual Machine
Implemented as Linux device driver
Requires a hosting Linux system/distribution (Selected
RHEV-H)
 Operating System certifications: Linux (RHEL and SLES)
and Windows
 OS Support (64 bit only):
–
–
–
RHEL 5.5, SLES 11 (SP1), Additional versions to follow
Windows Server 2008 (SP2) for Data Center
Windows Server 2008 R2 for Data Center
 Provide KVM virtio drivers from RedHat for all supported
versions/editions
22
© 2010 IBM Corporation
Encrypted and
Signed SOAP/HTTP
In-the-clear
SOAP/HTTP
Linux
Linux
Linux
Virtual Machine
zOS
Virtual Machine
zOS
DataPower Integration
SOAP
z/VM
SOAP
AIX
AIX
AIX
PR/SM
Linux
Linux
Linux
SOAP
pHyp
Cobol/
MQ
Appl
Clients
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
AIX
xHyp
xHyp
xHyp
xHyp
xHyp
pHyp
pHyp
pHyp
pHyp
pHyp
Linux
Z CPU, Memory and IO
SE
SE
23
z Blade Extension
z Blade Extension
z Blade Extension
AMM
AMM
AMM
ISS
ISS
DP
ISS
DP
Cell
DP
Cell
DWA
HPC
DWA
DWA
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
Linux
PR/SM
Power
Linux
Linux
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
Virtual Machine
zOS
x86
z/VM
xHyp
Malicious
SOAP/HTTP




Deep-content routing and data aggregation
SOA Stack Acceleration
Application-layer security and threat protection
Protocol and message bridging








Blade Hardware Management
Energy Monitoring and Management of DP Blades
DP Firmware Load and Update
HMC Console Integration
PPM Assisted Dynamic Load Balancing (Future)
IEDN Virtual Network Provisioning
Monitoring and Reporting
DP Failure Recovery and Restart
© 2010 IBM Corporation
IBM zEnterprise System
The Value begins at the heart of z196…….
40%
30%
60%
Improvement for traditional
z/OS workloads
Improvement in CPU
intensive workloads via
compiler enhancements
Total capacity
improvement
zEnterprise 196 (z196)
Machine Type: 2817
Models: M15, M32, M49, M66, M80
Technology and Performance
Enhanced Availability and Serviceability
1 to 80 configurable for client
use
Workload Optimized Simplified Management
IFL, zIIP, zAAP, ICFs and optional
SAPs
Dynamic Energy optimized
Up to 3 TB RAIM memory
15 subcapacity settings
Cryptographic enhancements
Optional water cooling and/or HV
DC Power
Upgradeable from z10 EC and z9
EC
24
IBM Confidential
© 2010 IBM Corporation
IBM zEnterprise System
…… and the value extends to heterogeneous workloads ……
IBM zEnterprise BladeCenter Extension (zBX)
Machine Type: 2458 – Model 002
 Integrated IBM Certified Components driven by System z
order
– Standard parts – TOR switch, BladeCenter Chassis,
Power Distribution Units, Optional Acoustic Panels
 System z support
– Problem reporting, hardware and firmware updates
Optimizers
IBM Smart Analytics Optimizer
IBM WebSphere DataPower
(XI50z for zEnterprise)
Select IBM Blades
IBM BladeCenter PS701 Express
IBM BladeCenter HX5 7873
 Expanding operating system support for z196
– AIX on POWER, Linux, and Windows on System x
One to four – 42u racks –
capacity for 112 blades
 Simplified management
– Improved time to implement new applications
– Central point of management for heterogeneous
workloads
– No change to applications
No MIPS/MSU rating
… managed by the
Configured for high
availability
Integrated 10Gbe data
network
Optional rear door heat
exchanger
zEnterprise Unified Resource Manager
25
© 2010 IBM Corporation
zEnterprise technology designed for small and mid-sized businesses
The Value Begins At the Heart with the z114 …
Up to
zEnterprise 114 (z114)
Machine Type: 2818
2 Models: M05 & M10

New technology in a new package
►
►
►
►
►
►

Improved Platform Economics
►
►
►
►
26
Modular 2 drawer design for lower cost of entry
Granularity for right-sizing your system
Additional Scale for consolidation and growth
Improved data center efficiency
Same Qualities of Service as the z196
Hybrid enabled to drive workload expansion and
integration
New Software Curve
Lower Hardware Maintenance
Lower specialty engine and memory prices
Upgradeability for investment protection
18%
Up to an
ADDITIONAL
25%
Up to
Scales
From
Improvement for traditional
z/OS workloads 1
Improvement in CPU
intensive workloads via
compiler enhancements2
12% Total capacity improvement 1
26 - 3100 MIPS
Up to
130 available capacity settings
From
1-10 configurable cores for client
use includes CPs, IFL, zIIP, zAAP,
and ICFs
From
0-2 IBM provided spare cores
Up to
256 GB RAIM fault tolerant memory
Fully Upgradeable from the IBM System z10
Business Class™ (z10 BC) & IBM System z9®
Business Class (z9 BC); and to the z196 M15
© 2011 IBM Corporation
Download