September 16, 2010
Business Analytics on System z
Changing Business with Information
© 2010 IBM Corporation
Agenda
 The Changing Environment and Requirements
 The System z Solution Foundation
 IBM Smart Analytics System 9600
 IBM Smart Analytics Optimizer
 Getting Started
2
© 2010 IBM Corporation
The world is changing and becoming more…
Instrumented
Interconnected
Intelligent
The resulting explosion of information
creates a need for a new kind of intelligence
… to help build a Smarter Planet
3
3
© 2010 IBM Corporation
3
Imagine If Your Decision Makers Could…
…predict and treat
high-risk patients to
proactively intervene
at time of visit?
…identify inventory
levels and order
demands at time of
order?
…determine which
discounts will drive
additional sales if
offered at time of
sale?
…apply inferred social
relationships of
customers to prevent
churn?
Physician
Supply Chain
Manager
Retail Sales
Manager
Telco Loyalty
Manager
…optimize every transaction, process and decision at
the point of impact, based on the current situation,
without requiring that everyone be an analytical expert
4
© 2010 IBM Corporation
Business Requirements Have Changed
… and again require highest Quality of Service
 According to Gartner:
– Fewer than 15% of data warehouses in 2007 have been
designed to provide high availability, failover, disaster
recovery and the remaining components of mission-critical
systems.
– The mixed workload performance will become the single
most important performance issue in Data Warehousing
– Over 60% of current data warehouses fail when attempting
to deliver in-line operational BI and Analytics
• Resulting in lost revenue or increased costs.
 System z is again at the forefront
– Proven reliability and continuous availability capabilities
– Industry leading availability and workload management
capabilities
– Exploiting synergic effects of proximity to the operational
data
– Leveraging your investments in the platform
5
© 2010 IBM Corporation
Getting To The Answers Is Not Always Easy
The Pressure is On!
6

No way I can deploy a new
system by next quarter!

What is our consolidated
revenue?, I keep getting different
answers…

One solution, five vendors, ten
support numbers, ..we might as
well be system integrators.

Revenue & profits are down,…..
only thing that is up is my quota.

Whatever I spend to solve
today's problem must be relevant
to solve tomorrows as well.

Even if I had the applications I do
not trust my information.

No way my infrastructure can
support these new requirements.
© 2010 IBM Corporation
6
What Clients are Telling Us
We Need …………………….
• We Need a Single System to Deliver
Our Analytics Needs

 Reduced integration costs
Simplified planning, purchase,
deployment, maintenance, and
growth
 Less Storage, Server and floor
Space required

Designed for Enterprise class
analytics and performance
 Reduced Energy Consumption

Pay as you grow Modular-based
Deployment
 Flexibly add user and data capacity
to meet growth requirements
• We Need Faster Time To Value
7
 With Reduced Cost Of Ownership

Pre-Built for Rapid Deployment

Pre-tested and Configured to your
requirement

Out of the Box Performance

Minimized risk through standards
and proven best practices
 Reduced Labor
 Improved system management
 And Greater Access to Information and
Analytics
 Pre-Configured Business
Intelligence Modules with flexibility
of functionality and style of delivery
 Optimized and integrated OLAP
capability gives you performance at
the speed of thought
© 2010 IBM Corporation
IBM System z…the platform for the future
"you cannot think seriously about your longer-term IT architecture
without thinking equally seriously about what today's mainframe
environment has to offer“
CIO Magazine: Mainframe computing is
set for a rebirth – September 29, 2009
8
8
© 2010 IBM Corporation
The System z Solution Foundation
9
© 2010 IBM Corporation
Data Warehouse/BI Basics
- Four stages between Data and Information
Present
Transform/
Optimize
IBM SPSS
Decision
Management
Store
Cubing
Warehouse
Acquire
ETL
ELT
Data Quality
Replication
EAI
EII
Operationa
l
Application
s
Operational Source Systems
Structured/ Unstructured Data
10
© 2010 IBM Corporation
The IBM Data Warehouse Solution on System z Foundation
Solution Edition for zDW
z/OS LPAR
Operational System (OLTP)
Enterprise Data Warehouse
z/OS
z/OS LPAR
 Consolidation of mission-critical
data on System z
 Ability to leverage existing
environment, high availability,
backup and governance
procedures as well as skills
 Efficient data movement between
LPARs and DB2 Subsystems
InfoSphere Replication Server
DB2 for z/OS
DB2 for z/OS VUE
Data Sharing Group
ELT
Linux
LINUX ON SYSTEM Z – or z/VM LPAR
InfoSphere
Information
Server
InfoSphere
Warehouse
Cognos
BI Server
 Performance and TCO
improvements through cubing
services (data marts) and DB2
enhancements
 Complex transformations and
data quality driven from Linux on
System z with Information Server
 Low Latency movement of data
with Replication Server
Solution Edition for Enterprise Linux
11
© 2010 IBM Corporation
The IBM Solution: IBM Information Server
Delivering information you can trust
IBM Information Server
Unified Deployment
Discover, model, and
govern information
structure and content
Standardize, merge,
and correct information
Combine and
restructure information
for new uses
Synchronize, virtualize
and move information
for in-line delivery
Unified Metadata Management
12
12
© 2010 IBM Corporation
InfoSphere Warehouse on System z
 Provides a highly scalable, resilient, lower cost way to design, populate and optimize a
DB2 for z/OS Data Warehouse
 Adds core data warehouse and analytics capability to DB2 for z/OS
– Advanced physical database modeling and design
– In-database data movement and manipulation capabilities of SQL Warehouse Tool (SQW)
– Optimize multidimensional reporting and analysis of data with Cubing Service
SQW
Excel
MDX Queries
Cubing Services
OLTP DB2
13
13
13
Cognos
DWH DB2
© 2010 IBM Corporation
IBM InfoSphere Warehouse Cubing Services
IBM Business Analytics
Primary OLAP Use:
Large enterprise IT deployments
Operational Planning, Financial
analytics, business reporting
Ideal for:
• Very large data sets with very large
dimensions
• Enterprise rollouts requiring near
real time data
Cubing Services
Warehouse Modeling
Infosphere
Warehouse
14
14
Because of its unique:
• Scalable, low latency OLAP
• Standard, Open APIs
• Integrated IT tooling
For IT departments
© 2010 IBM Corporation
Cognos
Optimized Decision Making
Intuitive and tightly integrated capabilities accommodate
decision makers with different needs and skill sets
Easy access to a consistent, trusted and relevant view of
information where, when and how it is needed
Common Business Model
Message
Sources
15
15
Relational
Sources
Application
Sources
OLAP
Sources
Modern and
Legacy Sources
© 2010 IBM Corporation
H
Cognos
Measure and Monitor to See “How” You’re Doing
Dashboards
• Provide at-a-glance, high impact views of complex
information
• Help quick focus on issues that need attention and action
• Combine information across disparate sources
• Benefit from range of highly visual personalized,
managed, or self-assembled dashboards
• Gain personalized views of operations with continuous
monitoring
Real-time Monitor Business Operations
Monitor
• Continuously monitor and alert when
exceptions occur to take immediate action
Alert
• Detect events, anomalies and trends in data streams
flowing through transactional and messaging systems
• Aggregate data streams across multiple transactional
systems and data sources
Respond
16
16
Analyze
• Enable self-service with user-defined dashboards,
operational KPIs, and alerts
• Address full operational decision cycle from detection to
action
© 2010 IBM Corporation
J
Start to Understand the “Why” Behind Business Performance
Reporting
• Address full breadth of report needs (personalized,
transactional, management, statutory, production…)
• Deliver consistent information across all types of output
• Personalize and target to each department/individual
without having to re-author
• Re-use queries, analyses, express author reports in
business and collaborate on design with IT
• Easy access to data lineage, definitions of terms, and
annotations
Ad-hoc Query
• Intuitive, self-service reporting
• Access to all data; drag and drop query creation
• Easy sorting and filtering
• Corporate templates for consistency
• Share ad-hoc or promote for professional distribution
17
17
© 2010 IBM Corporation
Miami Dade County Success Story –
Why Leverage Cognos 8 BI for Linux on System z
Objective: Using System z to standardize on a single BI solution
Requirements:
Results:
 Demand for BI has really taken off
– New regulatory reporting requirements
– Every new system, every new solution, every
new application is having a business
intelligence component
 11 days to move from distributed to System z
deployment model for Cognos 8 BI
– Quickly and easily meet new requirements
 Multiple Cognos 8 BI deployments - 6+
 Single point for BI administration
 Wanted an enterprise BI standardized
solution, but
– Needed higher capacity – grow from approx
400 to 1000 users
– Do more with less - less researchers, less
software, less hardware, same staff
– Had available IFL’s on System z
 Consolidate multiple disparate data sources
18
 Consolidate multiple BI deployments on to a
single platform
 Ensure 99.999% availability
 Offer a complete disaster recovery plan
 Additional green savings
© 2010 IBM Corporation
IBM Smart Analytics System 9600
19
© 2010 IBM Corporation
IBM Smart Analytics System Offerings Deliver Analytics
Value Across Platforms
Faster Time to Value, Faster Business Results
5600
Meeting clients where
their information is…
Based System x
Consistent value,
Right fitted to your needs
20
7600
9600
Based Power System
Based on System z
© 2010 IBM Corporation
IBM Smart Analytics System 9600
Delivers - unprecedented value in deploying new business analytics
 What’s new:
– Delivers a complete end-to-end software, hardware, and services solution for deploying business
analytics on System z at a compelling price point.
 Features / Business Value:
– Provides unprecedented value for an end-to-end analytics solution on System z
– Inherits the unique System z quality of service, for new business analytic workloads
– Delivers continuous availability to a centralized single view of the business to support enterprisewide business analytics
– Features an advanced Workload Manager that can easily prioritize critical queries within a large
pool of queries.
– Leverages customers existing disaster recovery, and backup processes to simplify deployment
without requiring additional backup and recovery processes.
Client Benefits:
– To deliver enterprise-wide business analytics
to operational users
– Deliver business insights to the right person,
at the right time, in the right context
21
© 2010 IBM Corporation
IBM Smart Analytics System 9600
High Value Dynamic Warehousing
Cognos 8 BI
System z
InfoSphere
Warehouse
Cubing
Services
Data
Warehouse
Powercube
Services
ELT
DB2 for z/OS VUE
(option for MLC)
Implementation
Services
DB2 Utilities Suite
Operational Source Systems
Structured/ Unstructured Data
22
Image Copy, LOAD, UNLOAD,
REORG, etc
© 2010 IBM Corporation
Choose A Deployment Style
Standalone Delivery
Server delivered in
“appliance-like” fashion
Virtual Upgrade
Delivery
Capacity delivered as a “bolton” to existing server(s) or as
new server(s) depending on
customer needs in a “virtual
appliance-like” fashion
23
© 2010 IBM Corporation
IBM Smart Analytics System
Pre-Set Configurations Sized to Meet Business Requirements
Data Capacity Sizing
DB2 Base
Amt Usable Disk*
Amt
User Data*
240TB
100TB
120TB
50TB
60TB
25TB
24TB
12TB
8TB
4TB
*Usable = Disk storage delivered for compressed table
data, indexes, work files, MQTs etc.
*User Data = Processing capacity delivered to support
this amount of raw, uncompressed, user business data
24
© 2010 IBM Corporation
IBM Smart Analytics System
Pre-Set Configurations Sized to Meet Business Requirements
BI Capacity Sizing
Cognos Workload
Named Users
Max Concurrent Users
10,000
100
50
5
25
*Named User = Licensed Cognos User
*Concurrent User = Users that are doing work (consuming CPU) in the
Cognos application, DB2 or both
25
© 2010 IBM Corporation
What exactly is a “User”?
“Named User”
“Active User”
“Concurrent User”
“DB2 ‘In-Use’ Thread
User”
This is a licensed
Cognos user.
This is a member of the
subset of “Named
Users” that are
currently logged in to
the Cognos application
Users that are doing
work (consuming CPU)
in the Cognos
application, DB2 or
both
Users that are actively
running in DB2
(consuming CPU in
DB2)
Best defined as the
general user
community that may or
may not be using the
Cognos application at
any given point in time
This user community
includes users that
are:
The Cognos work may
or may not incur work
in DB2
26
– Actively doing work in
the application (which
may or may not also
incur work in DB2)
– In “think time”
– Have walked away from
their machine
© 2010 IBM Corporation
IBM Smart Analytics System Optimizer
27
© 2010 IBM Corporation
IBM Smart Analytics Optimizer
What is it?
The IBM Smart Analytics Optimizer is a
workload optimized, appliance-like, add-on, that
enables the integration of business insights into
operational processes to drive winning
strategies. It accelerates select queries, with
unprecedented response times.
How is it different
 Performance: Unprecedented
response times to enable 'train of
thought' analyses frequently blocked by
poor query performance.
 Integration: Connects to DB2 through
deep integration providing transparency
to all applications.
 Self-managed workloads: queries are
executed in the most efficient way
 Transparency: applications connected
to DB2, are entirely unaware of the
accelerator
 Simplified administration: appliancelike hands-free operations, eliminating
many database tuning tasks
Breakthrough Technology Enabling New Opportunities
28
© 2010 IBM Corporation
IBM Smart Analytics Optimizer
Query Execution Process Flow
Application
Interface
Heartbeat
Optimizer
Worker 1
Worker 2
Query execution run-time for
queries that cannot be or should
not be off-loaded to IBM SAO
Coordinators
IBM SAO interface
Application
Worker 3
.
.
.
Worker n-1
Worker n
DB2 for z/OS
IBM SAO
Heartbeat (IBM SAO availability and performance indicators)
Queries executed without IBM SAO
Queries executed with IBM SAO
29
© 2010 IBM Corporation
Extreme performance for complex queries
Game Changing Performance
 Rapidly delivers information to decision
makers through breakthrough
technologies providing dramatic
performance improvement.
 The best of row and columnar store
technologies
 Highly compressed data
 Compressed data operations
 In-memory processing
 Massively parallel architecture
 Enables decision makers to submit
queries they never dared in the past, that
analyze trends, predict outcomes, and
produce better business results.
30
© 2010 IBM Corporation
Database Performance Appliance
Significantly reduces costs and
enables quick time to value
 Appliance-like, add-on device
 Application transparent, install and
begin reaping the benefits of higher
performance
 Rapidly add new applications and user
requirements driving immediate value to
the bottom line
 No need for indices, materialized query
tables (MQTs), query plans or query
hints
31
© 2010 IBM Corporation
Proven Operational Characteristics
Integrated infrastructure that is managed by System z
through Hardware Management Console and firmware
Benefits of a System z workload
optimized infrastructure
It broadens the System z Qualities of
Service of manageability, security,
availability to the business intelligence
and data warehouse workloads.
It extends the established System z
hardware management environment to
the workload optimized platform.,
centralizing and simplifying the
deployment and management
Creates New Opportunities for Existing Systems
by Using New Technology Approaches
32
© 2010 IBM Corporation
Comparing the Smart Analytics offerings in System z:
IBM Smart Analytics
System 9600
IBM Smart Analytics
Optimizer
Uses Features of Accelerator
GA June 2010
GA 4Q 2010
Complete, end-to-end environment for BI workload
Processes ALL queries submitted by end-users
Workload optimized, appliance-like, add-on to a
Data Warehouse on System z
Software:
Includes z/OS, DB2 for z/OS, Linux, InfoSphere
Warehouse, Cognos, DB2 Connect
Supports:
Data movement / ETL
End user tools (Cognos) / BI queries/reports
Data Storage (Data warehouse)
Runs in z/OS-DB2 LPAR, Linux for System z LPAR for
Tooling
Is an all purpose environment to deploy any BI
workload
MUST connect TO a DB2 for z/OS environment that
is running a BI workload
Will enhance a Smart Analytics System 9600
Software:
Includes IBM SAO software running on blades and
connects to DB2 for z/OS to enable query routing
to IBM SAO
Supports:
(Subset of) complex and long-running BI queries
with access to data in a star or snowflake schema
Order of magnitude acceleration of a SUBSET of
queries that are selected/routed to IBM SAO by
DB2 for z/OS
For acceleration of multidimensional star schema queries, use IBM Smart Analytics Optimizer as add on option
33
© 2010 IBM Corporation
Getting Started
34
© 2010 IBM Corporation
Websites for Additional Information:
IBM Smart Analytics System 9600 Webpage:
http://www.ibm.com/software/data/infosphere/smart-analytics-system/
IBM Smart Analytics System Optimizer Webpage:
http://www.ibm.com/software/data/infosphere/smart-analytics-optimizer-z/
Data Warehousing and Analytics
http://www.ibm.com/software/data/infosphere/data-warehousing/
Data Warehousing and Business Intelligence on System z
http://www.ibm.com/software/data/businessintelligence/systemz/
Terabyte Club for System z BI customers
http://www.ibm.com/software/data/businessintelligence/systemz/terabyte-club.html
Data Governance on System z
http://www.ibm.com/software/data/db2imstools/solutions/compliance.html
35
© 2010 IBM Corporation
Some Key Redbooks
 Enterprise Data Warehousing with DB2 9 for z/OS
• www.redbooks.ibm.com/abstracts/sg247637.html?Open
 50 TB Data Warehouse Benchmark on IBM System z
• www.redbooks.ibm.com/abstracts/sg247674.html?Open
 DB2 for z/OS: Data Sharing in a Nutshell
• www.redbooks.ibm.com/abstracts/sg247322.html?Open
 System Programmer’s Guide To: Workload Manager
• www.redbooks.ibm.com/abstracts/sg246472.html?Open
Cognos on
System z,
Data
Collocation,
and
InfoSphere
Warehouse
also in
progress!
 Workload Management for DB2 Data Warehouse, REDP-3927
• www.redbooks.ibm.com/abstracts/redp3927.html?Open
36
© 2010 IBM Corporation
Dynamic Warehouse
Global
Name
Recognition
The Integrated Stack for System z
Smart Analytics
System 9600
InfoSphere
Industry Models
Cognos
BI
SPSS
Global Name
Recognition
InfoSphere
MDM Server
InfoSphere
Warehouse
Master
Data
Warehouse
InfoSphere
Information
Server
Cubing
Information
Services
Director
Operational
Applications
Smart
Analytics
Optimizer
Data Synchronization
Data Quality
ETL
Operational Source Systems
Structured/ Unstructured Data
37
Federation
Change Data
Capture
Replication
Server
Classic
Federation
Classic Event
Publisher
© 2010 IBM Corporation
Dylan Murphy
System z InfoSphere and Data
Warehousing Technical Specialist
dsmurphy@us.ibm.com
(914) 766-7248
38
© 2010 IBM Corporation