IBM cloud offering for the academia (HPC

advertisement
Avi Vizel
Evangelist & Cloud Sales Manager
IBM Cloud division
IBM Israel
IBM is investing $1.2B in new cloud resources to significantly expand
SoftLayer presence
Data Centre and Network Point of Presence
Network Point of Presence
6
SoftLayer: Global IaaS Leader
7
• High-performance public network with transit from multiple tier-1 carriers
• Secure OOB management via VPN
• Private network for intra-application and inter-facility communications, access to shared services
• Native IPv6 support
• Virtual racks for integrated management
• Complete suite of network services
8
Reserved
Shared virtual
servers
Private virtual
servers
Bare Metal servers with
your own stack
Off premises
9
SoftLayer enables enterprise-grade,
best-in-class performance and reliability
Differentiation:
Unique capabilities and design:
Superior throughput
High security
Performance
Redundant, high capacity
networks
Fully customizable
Flexibility
Easily scalable
Simple, powerful
management
24x7 support
Control
Full visibility
10
Compliance
IBM is ranked as the #1 hybrid and
private cloud provider for the
enterprise
February 2015
IBM is ranked #1 for current
hybrid cloud implementations
June 2014
11
SoftLayer is designed to offer complete transparency.
With SoftLayer,
you know:
 Data
center
 Pod
 Rack
 Rack unit
 Power port





Network port
Server
NIC controllers
Firmware
Serial numbers
Plus
 Audit trail of all actions
and access to
resources
12
Application
Application
Application
Business Process as a Service
Software as a Service
External
Ecosystem
Industry
Collaboration
Commence
Analytics
Marketing
Platform as a Service
Development
Analytics
Data
Mobile
Security
Traditional
Workload
Compute
Storage
Human
Resources
Integration
Networking
Infrastructure as a Service
13
IBM has the most on-ramps to the cloud
Cloud managed services
softlayer bare Metal
Softlayer Pure Application
Systems
Bluemix
IBM SaaS Application
Bring Your Own
License
Application
Idea
Customers
Addressing key concerns: Data placement, Security, Speed
14
When to Use What?
Virtual Public
Virtual Private
Bare Metal
Hybrid
• Windows & Linux applications
• Web Servers
• Back office applications
• Performance Needs
• Isolation needs or multitenancy concerns
• Performance Needs (DB, HPC, Production)
• Build Your Own Cloud (VMware, Hyper-V, Citrix, OpenStack)
• Isolation, Compliance & Security Needs
• Combination of above
15
Ready to Use High Performance Clusters in the Cloud
IBM Platform Computing Cloud Services
IBM Platform LSF
(SaaS)
IBM Platform
Symphony (SaaS)
IBM Elastic Storage
(Based on IBM GPFS technology)
IBM
High Performance
Services for Hadoop1
HDFS
SoftLayer Infrastructure
24x7 CloudOps Support
1.
Note that IBM High Performance Services for Hadoop is a working name and is subject to change
16
IBM Platform LSF (SaaS)
Load Sharing facility
IBM Platform
Analytics
IBM Platform
Application
Center
Overview
Powerful workload management for demanding, distributed and missioncritical high performance computing environments.
Key Capabilities
• Complete
- Advanced workload scheduling
- Robust set of add-on features
- Integrated application support
IBM Platform
Process
Manager
IBM
Platform
RTM
Platform
LSF
• Flexible
- Heterogeneous platform support
- Policy-driven automation
- CLI, web services, APIs
• Powerful
•
- Policy and resource-aware scheduling
- Resource consolidation for optimal performance
- Advanced self-management
Scalable
- Thousands of concurrent users and jobs
- Virtualized pool of shared resources
- Flexible control, multiple policies
IBM
Platform
MPI
IBM Platform
Dynamic
Cluster
Scheduling
Extensions
IBM Platform
Data Manager
for LSF
IBM Platform
License
Scheduler
IBM Platform
Session
Scheduler
Client Benefits
Optimal utilization: reduced infrastructure cost
Robust capabilities: improved productivity
High throughput: faster time to results
17
17
IBM Platform
Symphony (SaaS)
Overview
Low-latency grid management platform for distributed computing and
analytics with sophisticated resource sharing
Key Capabilities
• Accelerates service-oriented applications
• Extreme app scalability and throughput with very low latency
• Compute and data-intensive applications on a single platform
• Sophisticated, hierarchical resource sharing
• Open and flexible: choice of OS, frameworks and languages
Low Latency / High throughput
Sub-millisecond, 17,000 tasks per second
Client Benefits
• Increase performance and analytic result quality
• Reduces IT costs - increase utilization, simplify application onboarding,
reduce administration costs
Large Scale
10k cores per application, 40k cores per grid
Efficient shared services
Heterogeneous & Open
Linux, Windows, AIX, C/C++, C#, Java, Excel,
Python, R
18
IBM High Performance Services for
Hadoop
Fully functioning Hadoop clusters as a service for MapReduce
and Analytics workloads on the SoftLayer cloud
IBM InfoSphere BigInsights
•Hadoop resources as needed – Access clusters on a temporary
basis without the need to acquire, install & configure
•Reduce the risk – Explore Hadoop, various distributions, version &
the value of your data without making a commitment
•Keep costs low – Pay for only what is used
•Expected and reliable performance – Run on physical machines
•Secure – Clusters are deployed on dedicated
•Peace of mind – Access support for the whole solution (HW & SW)
as needed 24 x 7 x 365
•Fully managed services – Optionally available
•Professional Services – Installed, configured & administered by
skilled CloudOps team
1.
Note that IBM High Performance Services for Hadoop is a working name, and is subject to change
(i.e., unshared) bare metal machines, in a VLAN,
with a VPN connection, at a named data center.
and staffed by HPC & Hadoop professionals with
over a decade of experience
19
IBM Spectrum Store
(Based on IBM GPFS technology)
 More storage capability, lower costs - Easily meet additional
resource demands without the cost of purchasing or managing inhouse infrastructure
 Secure - Ensure data security with physical isolation of cloudbased bare metal resources
 Invisible user experience - Seamlessly transfer files between local
and cloud-based resources
 Easy public cloud adoption - Minimize administrative burden with
fully supported, ready-to-run software defined storage in the
cloud
What’s new
• Highly available and scalable Elastic Storage software delivered as a service on SoftLayer
• Deployed on dedicated bare metal resources for optimal I/O performance and data security
• Optimized for analytics, technical computing & Hadoop workloads
• Installed, integrated & administered by skilled Cloud Ops team
20
Conceptual HPC Architecture: on premise and cloud
Users ISV Application
IBM Platform LSF
IBM GPFS
Burst
APP
APP
APP
LSF
Compute
LSF
Compute
LSF
Compute
APP
LSF
… Compute
LSF
Sym
Master
Master
LSF
MC
or
Stand-alone
IBM LSF MC communications
On Premise Cluster
Secure VPN tunnel via
Vyatta appliance
IBM aspera FASP
Shared Filesystem
IBM GPFS Active File Management
IBM Elastic Storage
On-premise infrastructure
LSF
Sym
Master
Master
LSF
MC
APP
APP
APP
APP
APP
LSF
Compute
LSF
Compute
LSF
Compute
LSF
…
Compute
LSF
Compute
APP
…
LSF
Compute
Cloud Resident Cluster
Shared Filesystem
IBM Elastic Storage
Dynamically provisioned infrastructure
On bare-metal resources in SoftLayer
Predictable Performance Matters
•
•
•
LSF provides workload management,/job scheduling, making the most out of the resources available
GPFS provides high performance shared parallel file system, able to scale to petabytes
FASP provides bulk data transfer without the burden of the TCP/IP stack
21
Industry-leading workload management in the IBM SoftLayer Cloud!
• 20 years managing distributed scale-out systems with 2000+ customers in many industries
• High performance workload management combined with intelligent resource scheduling engine
• Unmatched scalability (small clusters to global grids) and production-proven reliability
23 of 30 largest
commercial
enterprises
• Heterogeneous – manages System x and Power plus 3rd party systems, virtual and bare metal, accelerators / GPU,
cloud, etc.
• Shared services for both compute and data intensive workloads
• Integrated solutions with vertical reference architectures
60% of top
financial
services
companies
IBM Hybrid Cloud
Over 5M CPUs
under
management
22
Choosing the Right IaaS Platform
23
With the SoftLayer technology, STU boosted enrollment in the physical sciences by 30 percent and increased
retention across science disciplines by 30 percent
24
Download