HP AppSystem for SQL
Server PDW
Steve Tramack
Sr. Engineering Manager
HP/Microsoft I2A Solutions
April 2013
© Copyright 2013 Hewlett-Packard Development Company, L.P. The
information herein is subject to change without notice. HP Restricted.
The world of Data has changed
10x
4.3
increase
every five
years
connected
devices per
adult
85%
from new
data types
2
Data
explosion
Consumerization
of IT
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
27%
using social
media input
But current “big data” options are limiting
Keep legacy
investment
Limited
scalability
3
Buy new tier one
hardware appliance
Acquire “Big Data”
solution
High
costs
Significant
training
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
Acquire Business
Intelligence
Solution
complexity
Introducing SQL Server 2012 Parallel Data Warehouse
Insights on any data of any size
Built For Big Data
4
Next-generation
Performance At Scale
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
Engineered For
Optimal Value
Introducing PolyBase
Fundamental breakthrough in data processing
Single Query; Structured and Unstructured
SQL
SQL Server 2012
PDW Powered by
PolyBase
Database
5
HDFS
(Hadoop)
• Query and join Hadoop tables with Relational Tables
• Use Standard S SQL language
• Select, From Where
Existing SQL
Skillset
No IT
Intervention
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
Save Time
and Costs
Analyze All
Data Types
Existing Excel skillset with big data
Familiar tools to analyze structured/unstructured data
Familiar Tools Analyze Big Data
• Native Microsoft BI Integration to PDW
• Structured and unstructured data in same spread sheet
• Widely adopted and familiar user tools
Hadoop
Data
Structured
Data
6
High Adoption
Of Excel
No IT
Intervention
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
Analyze All
Data Types
Xvelocity gives next-gen performance
Lighting fast data query processing
Country
Supplier
Sales
Products
Customer
Columnstore
Provides
Dramatic
Performance
Columnstore
Provides
Dramatic
Performance
Updateableand
andclustered
clusteredxVelocity
xVelocitycolumnstore
columnstore
• •Updateable
• Stores data in columnar format
Memory-optimized
for next-generation
performance
• •Stores
data in columnar
format
• Updateable to support bulk and/or trickle loading
• Memory-optimized for next-generation performance
•
Updateable to support bulk and/or trickle loading
Upto
to
Up
50XFaster
Faster
50X
7
Upto
to15x
15x
Up
compression
compression
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
Save Time
and Costs
Real-Time
DW
Seamlessly Add Capacity
Start Small With A Few TB and Linearly Scale OUT
Smallest (0TB) To Largest (6PB)
Add
Capacity
• Start small with a few Terabyte warehouse
• Add capacity up to 6 Petabytes
Add
Capacity
Start Small
And Grow
75TB
8
6 PB
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
Largest
Warehouse
PB
No Downtime
Hardware and Software engineered together
The ease of an Appliance
Pre-Built Hardware + Software Appliance
• Co-engineered with HP
• Pre-built and configured hardware
• Pre-installed software
“Plug and Play”
9
Built-in Best
Practices
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
Save Time
HP AppSystem for PDW v2
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.
Deep integration for rapid time to value
HP AppSystem for Parallel Data Warehouse
Onsite deployment services
Microsoft Windows® 2012 and Microsoft SQL Server 2012
Parallel Data Warehouse software*
Hadoop integration
HP management tools and utilities
HP Converged Infrastructure: servers, storage and networking
Collaborative support services from HP and Microsoft**
HP and partner assessment, design, and planning services
11
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
* Priced separately
** HP Proactive Care. Microsoft support priced and purchased separately
Highly scalable
HP AppSystem for Parallel Data Warehouse components
FDR InfiniBand
2 x HP 5120 EI switches
• InfiniBand (data network) and
Ethernet (management
network) connectivity
Passive Server Block
• Passive Server Block (2)
• Optional passive server (3)
• Virtualized control and management
node; failover node for HA
Base Scale Unit
12
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
Active Server Block (2)
and Storage Block (1)
HP AppSystem for PDW v2
64 total node (active + passive) limitation (Windows 2012 clustering)
13
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
HP AppSystem for PDW – normal mode
Passive server (#1)
Control and management
functionality
Dual InfiniBand
Private Ethernet
network
Passive server (#2)
Compute nodes access their local
D6000 in their respective scale
unit
D6000
Compute nodes
SAS
Node 1
Node 2
Base scale unit
14
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
Storage 1
Storage 2
HP AppSystem for PDW – HA, Failover
Control and management functionality
Passive server (#1)
Compute node takes over (SQL Server)
• SQL Server runs in new compute node
• Data is accessed via InfiniBand RDMA access
Dual InfiniBand
Private Ethernet
network
Passive server (#2)
• Minimal performance impact on remote server
• Most CPU utilization is in the new compute node
D6000
Compute nodes
SAS
Node 1
Node 2
Base scale unit
15
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
Storage 1
Storage 2
HP Support Pack Utility Suite
HP AppSystem for
PDW exclusive!
Updated for HP AppSystem for PDW v2
Unique HP tools ensure that HP AppSystem for PDW runs at optimal performance and delivers
expected return on investment (ROI)
Up to 2,000 device drivers
and firmware locations
updated with a single click
Reports all serial
numbers and rack
locations of all
devices; hard disk
data and qualified
component versions
Manage device
password updates
from a single script
16
Validates the running of
known-good, consistentlyimplemented, tested
recipe of drivers and
firmware
Quickly identifies hardware
issues from shipment or
component failure
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
HP Proactive Care for HP AppSystem for PDW
Complete proactive and reactive support reduces risk
17
Advisory support
• Semi-annual firmware, patch, and software update recommendations
• Semi-annual proactive scan and recommendation
• Quarterly incident and trend reporting
Hardware and
software support
• Direct connection to level two expertise
• Documented, jointly agreed HP/Microsoft collaborative support
processes
• Single point of contact for end-to-end case ownership and call
management
• Enhanced response time and choice of HW on-site support levels
Insight remote
support
• Secure 24x7 monitoring, diagnostics, and notifications
• Required (installation assistance provided)
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
HP AppSystem for PDW
Assessment, deployment, and start services
Assessment
• Existing process review
• Optimize for EDW: ETL
and reporting
• Integration needs
assessment
• Two-week duration
Onsite deployment
services*
• System set-up
• Installation
• Delivery project
management
Start service
• ETL readiness and test
• Reporting, migration,
and testing
• Performance tune and
test
• Data center integration
• Operations review
• Two-week duration
Full lifecycle of Data Warehouse/business intelligence consulting
*Included in AppSystem price
18
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
HP and Microsoft Information and Data Management Solutions Portfolio
HP AppSystem for
Microsoft SQL
Server 2012 Parallel
Data Warehouse
A complete, all-in-one data
warehouse appliance for
mission-critical environments.
HP SQL Server 2012
Fast Track Data
Warehouse
Reference
Architectures (RA’s)
Full portfolio of high
performing, end-to-end
solutions designed for efficient,
predictable deployment and
optimized for near real-time
data delivery.
HP Universal
Database Solution
for Mission-Critical
x86 RA – Microsoft
SQL Server 2012
HP Database
Consolidation RA
Built for data management
applications that require high
levels IO / second support.
Designed to deliver cost
savings and efficiency through
database and application
virtualization.
HP and Partner Services for Data Management Solutions
Built on HP Converged Infrastructure
19
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
HP Differentiation
Leveraging HP Data Center Expertise through Converged Infrastructure
Mission Critical Support :
• Truly integrated support beyond standard break/fix
• HP-unique 7x24 “phone home” capabilities included in standard support offering
Data Integration Platform
•
Only HP offers a combination Landing Zone / Backup / Remote Support scale unit designed for PDW
More Scalability Options
•
HP PDW scales in increments of 2 servers
•
Allows for ¼, ½, ¾, full and (with AU1) “Texas Edition” (10+3) configurations
•
HP starts smaller and grows larger within a rack than competition
Support Pack Utility Suite:
•
HP Exlusive offering that reduces customer’s operational costs and eases maintenance, with tools such as the one-button update
which can update 2,000 components with a single click
Factory-Installed and Integrated for Rapid Time –to-Business-Value:
•
HP’s AppSystem PDW is a true mission critical appliance, fully configured at the factory, with extensive HP developed installation
documentation
20
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
HP AppSystem for PDW v2
Summary
Max TB/ft2
•2.5x more TB (vs. v1)
•70-210TB in ¼ rack
•6PB max
21
$ / Performance
• 35% less $ (vs. v1)
• Sub-$300k ¼ rack
• +10-30% scan rate
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
SW + Management
• 10-100x faster (xVelocity)
• 5x better compression
• Enhanced HP-only Utilities
Key Questions
What do you see as being the most compelling aspects of an Appliance solution
(versus a reference architecture)?
If HP had $100 dollars to spend on AppSystem for PDW Development, how much
would you spend on:
•
•
•
•
•
•
•
•
22
Additional hardware architectures
Manageability advancements
BI infrastructure
Industry-specific data models
Additional Support and Maintenance automation
Performance and Scalability optimization
Workload management (and other traditional DW capabilities)
Other aspects
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
Backup
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Restricted.
HP Enterprise Data Warehouse (EDW) V1.4 - Recap
Data rack
2 x FDR Infiniband
Control rack
2 x FDR Infiniband
Compute Nodes (10 active DL360,
1 passive DL360)
Backup storage
(2 x MSA P2000 each w/
3 storage shelves)
2 x StorageWorks 8/40 SAN switches
2 x ProCurve 2810/48G switches
Compute Node Storage
(10 x MSA P2000)
Backup server (DL380)
2 x StorageWorks 8/8 SAN switches
2 x ProCurve 2810/24G switches
Control Nodes (2 x DL380)
Control Node Storage (MSA P2000)
Management nodes (2 x DL360)
Landing Zone (DL380)
24
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
Agenda
SQL Server PDW 2012 Software Overview
HP AppSystem for PDW v2 Overview
•
•
•
•
•
Comparison of EDW v1 and PDW v2
Key component drill down
Scalability / capacity options
HA functionality
V1  V2 upgrade
Support Pack Overview
Bundled Services
HP Differentiation
Summary
25
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
HP AppSystem for PDW v2
Control rack
HP AppSystem for PDW V2
eliminates Landing Zone and Backup nodes
as part of the appliance
(offered as part of HP “Landing Zone and
Backup Platform” RA / SKU option)
26
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
Landing Zone and Backup platform
Provides key appliance functionality
Landing Zone / ETL Functions
•
PDW supports SSIS and bulk file loads through INSERT statements and dwloader program (PDW-specific)
•
Parallel loading supported, but all pass through single control node VM
SAS MDL
Dual Port 7.2K
1.0TB
SAS MDL
Full and differential backups (no incremental)
Dual Port 7.2K
•
1.0TB
Supports multiple backup devices, but single backup or restore operation at any time.
IO goes straight from all compute nodes to the backup location
SAS MDL
•
Dual Port 7.2K
Appliance backup through TSQL command, similar to standard SQL Server (CLI or GUI; can be scheduled)
1.0TB
•
SAS MDL
Provides file share for PDW Backup and Restore
1.0TB
•
Dual Port 7.2K
Dedicated Appliance Backup Target
SAS MDL
Dual Port 7.2K
SAS MDL
1.0TB
Dual Port 7.2K
SAS MDL
1.0TB
Dual Port 7.2K
1.0TB
SAS MDL
Dual Port 7.2K
1.0TB
SAS MDL
Dual Port 7.2K
1.0TB
SAS MDL
Dual Port 7.2K
SAS MDL
SAS MDL
1.0TB
Dual Port 7.2K
1.0TB
Dual Port 7.2K
1.0TB
UID
ProLiant
DL380p
Gen8
Insight Remote Support Server Host
•
27
24 x 7 monitoring
•
“Phone home” support
•
Part of Proactive Care, bundled with appliance
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
HP
StorageWorks
MDS600
1
2
8
9
15
16
22
23
29
10
17
24
31
11
18
25
32
5
12
19
26
1
30
3
4
33
2
UID
8
9
15
16
22
23
29
30
3
10
17
24
31
4
11
18
25
32
5
12
19
26
33
6
13
20
27
34
6
13
20
27
34
7
14
21
28
35
7
14
21
28
35
UID
HP AppSystem for PDW v2
Base Scale unit
Data rack
2+2, or “Quarter rack”
Control rack
FDR Infiniband
Ethernet switches
Passive server (#1)
Passive server (#2)
28
V1
V2
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
V1
HP AppSystem for PDW v2
8+2, or “Full rack”
Data rack
Control rack
FDR Infiniband
Ethernet switches
Passive server (#1)
Passive server (#2)
Active Scale Unit
Active Scale Unit
8
Compute node
functionality
Active Scale Unit
Base Scale Unit
29
V1
V2
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.
V1
Resources
Hewlett Packard
Microsoft
Joint HP-Microsoft
HP Enterprise Data Warehouse
Appliance
www.hp.com/solutions/microsoft/
edw
HP ActiveAnswers
www.hp.com/solutions/activeans
wers
Microsoft Parallel Data Warehouse
http://www.microsoft.com/pdw
SQL Server Developer Center
http://www.sqlserverlaunch.com/
ww/Home
SQL Server Team Blog
http://blogs.technet.com/b/datapl
atforminsider
SQL Server Product News
http://www.microsoft.com/sqlser
ver/en/us/news-reports.aspx
HP/Microsoft Joint Sales Portal
www.winthedatacenter.com
30
HP & Microsoft Frontline
Partnership Portal
www.hp-microsoft.com
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. HP Confidential.