云计算技术与架构前瞻
Presented by: Fubo Zhang
Proprietary and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
内容提要
• 云计算的市场前景
• 云计算的现状
• 云计算的技术、架构发展趋势
2
Proprietary and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
1979: CFD Contributions to the 767
Much CFD penetration.
Opportunities exist for higher
accuracy and expanded complexity
Some CFD penetration.
Opportunities exist for large increases
in design process speed and
application
CFD penetration opportunity
High-Speed Wing
Design
Cab Design
Inlet Design
Nacelle Design
Wing-Body
Fairing Design
Engine/Airframe
Integration
Copyright 2010 IDC. Reproduction is forbidden unless authorized. All rights reserved.
3
3
2005: CFD Contributions to the 787
Wind Tunnel Corrections
Cabin
Noise
Interior
Connexion
Air
Quality Antenna
Air Data
System
Location
High-Speed Wing
Design
High-Lift Wing
Design
ECS Inlet
Design
Cab Design
Icing
Design for FOD
Prevention
Inlet Design
Inlet Certification
Nacelle Design
Engine Bay Thermal Analysis
CFD penetration opportunity
Some CFD penetration.
Opportunities exist for large increases
in design process speed and
application
Much CFD penetration.
Opportunities exist for higher
accuracy and expanded complexity
Wing Tip Design
Control Failure
Analysis
Buffet
Boundary
Wing
Controls
Wing-Body
Fairing Design
Exhaust
System Design
Reynolds Number Corrections Thrust Reverser
Design
for Loads and S&C
Vertical Tail and
Aft Body Design
Design For
Stability &
Control
APU Inlet
And Ducting
Design For
Loads
Avionics Cooling
Engine/Airframe
Vortex Generator
Integration
Placement
Flutter
Wake Vortex Alleviation
Planform Aeroelastics
Design
APU and Propulsion
Community Noise
Fire Suppression
Copyright 2010 IDC. Reproduction is forbidden unless authorized. All rights reserved.
4
4
Copyright 2010 IDC. Reproduction is forbidden unless authorized. All rights reserved.
5
Gartner View of Private Cloud Market
可升级的
共享
自动化
弹性计算
6
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
6
451 Group View of the Cloud Market
管理
自动化
安全
存储
7
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
7
Forrester View on Cloud Computing
Platforms
8
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
8
云计算实现的3 条路径
Scope of sharing
网格
•
•
静态资源、动态调度
基于策略的调度
Public & Private Cloud
Enterprise
VM Cluster
Client/Server
Silos
•
•
•
同构服务器的整合
有限的应用
基于VM的管理功能
Workgroup
/ LOB
Time
2009
2003
9
Proprietary
and Confidential: Platform Computing Corporation
2015
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
9
公共云 -- What do we believe?
User
• 上网机
• Internet 接入上网
ESX
Virtual
Machine
Virtual
Machine
Virtual
Machine
Virtual
Machine
Virtual
Machine
Virtual
Machine
User
• 手机
• 移动上网 – 3G
PC cloud
虚拟机
User
• Workstation
• VIP 接入
物理机
10
Proprietary
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
10
公共云 -- What do I believe?
•
•
•
11
Proprietary
PC cloud
1. 上网笔记本等终端设备
2. 台式电脑、笔记本将会被淘汰
3. 虚拟PC服务运营商将会替代MS和google
Data Bank
1. 解决数据、信息安全的最终解决方案
2. 衍生许多种数据服务， 比如医疗健康，个人企业信用征
询，个人数据银行
Many SPs
1. PC SP
2. Storage SP
3. Game SP
4. Many SAAS SPs
5. Many other SPs
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
11
私有云
Analytics
LSF, Symphony, …
Java
Test & Dev
JBoss, Tomcat, …
Platform ISF
12
Proprietary
and Confidential: Platform Computing Corporation
HPC Apps
LSF, Symphony, …
Private cloud
management
software
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
今天IDC 数据中心的挑战
1.
数据中心体系很复杂， 系统
的维护和管理难度大
2.
IT成本高，资源占用多，配
置峰值资源需求
= 浪费资源
3.
4.
地理上分布的用户
根据应用静态分配IT资源
Web
eCommerce
Dev/QA
ERP
Intranet
BI
Email
CRM
系统稳定性、可靠性低。人
工服务为主，高成本、低满
意度
IT传统模式不能适应业务部
署速度的需求 （至少2个月
）
Supply and Demand Not Aligned
13
Proprietary
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
云计算（虚拟化）带来的好处
14
Proprietary
1.
资源虚拟化，从而实现全局共享
2.
SOA 框架使得IT能对业务需求提供快速部署， 时
间从原来的几个月缩短到半天
提高了业务支
撑能力
3.
一体化管理打破了原来IT烟囱式业务系统管理，
使得系统维护人员的效率大大提高
运维效
率提高
4.
消除单点故障造成的稳定、可靠性问题
高系统稳定性和可靠性
5.
帮助IT投资风险和决策
6.
节能减排
and Confidential: Platform Computing Corporation
节省投资
提
Smart IT
绿色IT
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
实现云计算（虚拟化）的困难
15
Proprietary
1.
没有成熟的产品和方案让运营商有直观的理解。
2.
各个厂商都在推、强调自己的云计算概念和产品
，像盲人摸象，无法让用户有个全局的认识。
3.
现有IT系统的改动成本和风险
4.
传统业务系统虚拟化改造
5.
少有成功案例可以借鉴
6.
组织管理和人们的认识需要提高
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
Platform在实现云计算方面的优势
16
Proprietary
1.
Platform已经有了自己的云计算产品ISF -- IAAS
2.
Platform的云计算产品是建立在许多用户的需求上
的， 如 JP Morgen, CityBank, Amazon, Alatum
3.
我们帮助用户实现小步快跑的策略， 降低IT系统
的改动成本和风险
4.
我们本地有近200名研发团队来协助用户的业务系
统虚拟化改造
5.
Platform已有几个云计算成功案例
6.
Platform可提供业务培训和成功用户案例考察
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
Java Cloud: Fortune 500 FS Companies
App 1
App
Server
App 2
App
Server
App N
App
Server
环境
100s Java 应用软件运行在1000s UNIX SMP
服务器
挑战
烟囱式的业务系统导致了系统部署时间长，资
源利用率低下，IT管理维护成本高
解决方案
App 1
App 2
App N
资源池方案： Linux, Xen/KVM 和 storage;
自服务管理, 调度自动化，管理一体化
Self-Service Portal
App Server
Benefits
Platform ISF
 系统部署的时间从几天缩短到几分钟
 没有双机备份
 低成本
Virtual Servers
17
Proprietary
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
SaaS Cloud: Fetch Technologies
环境
200 virtual servers in production and test/dev using
VMware
CUST A
CUST B
CUST C …
CUST X
Platform ISF
挑战
 由于手动部署业务系统，无法满足日益增长的业务
需求
 简单的用户系统配置的改变，需要几个小时乃至几
天
解决方案
利用私有云的技术Platform ISF自动管理和部署系统
Benefits
 满足了客户业务扩张的需求
 减少了认为的中间环节，提高了工作效率
 实现了Service on Demand
18
Proprietary
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
IaaS Cloud: SingTel
环境
Xen, VMware, Hyper-V, and physical blades on
2,400 cores providing public cloud services
挑战
在人工操作的方式下， 管理和维护出租
的计算机、计算用户使用情况和计费非
常的不方便
解决方案
利用私有云的技术Platform ISF自动管
理和部署系统
Benefits
 多快好省的为用户提供各种服务
 通过自动化管理， 降低了维护费用
 提升了市场竞争力
19
Proprietary
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
HPC Cloud: CERN
User A
Workload
Manager
User B
Workload
Manager
环境
RHEL, KVM, Xen, Hyper-V for widely diverse set of
scientific applications on x86 commodity boxes
挑战
系统无法为用户提供灵活的资源配置，
需要等待很长的时间
解决方案
User A
User B
利用私有云的技术Platform ISF自动管
理和部署系统
Benefits
Platform LSF
Platform ISF
20
Proprietary
and Confidential: Platform Computing Corporation
 在固有的资源上， 开发了更多的服务
项目; 对一些应用系统的运行效率提高
了一倍多
 降低成本， 提高资源利用率
 通过自动化管理， 降低了维护费用
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
3 个层次的云计算服务
SaaS
(Software as a Service，软件即服务)
PaaS
(Platform as a Service，平台即服务)
IaaS
(Infrastructure as a Service，基础架构
即服务)
应用软件对最终用户按需分配
e.g., Salesforce.com
APIs for developing new Cloud
apps
e.g., Google App Web
服务器， 网络，存储按需分配
e.g., Amazon EC2, S3
Each level provides a higher level of service abstraction
& may use lower level(s)
21
Proprietary
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
2015/4/9
21
云计算体系架构
云计算门户
SAAS
IDC 服务
IAAS 服务平台
服务应用系统
服务系统
服务调度和管理引擎
服务管理
云计算平台VM中间构建
IAAS 调度分配引擎
PAAS
IAAS
资源池
22
Proprietary
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
Placement Engine Policy
5) C-language plug-in placement policy:
•
vem_policy_init()
•
vem_policy_fin()
•
vem_policy_distribute()
•
vem_policy_place()
•
vem_policy_housekeep()
•
vem_policy_status()
•
vem_policy_info()
1) Application
Topology
Tier 1
DB
App
Server
App
Server
Web
Server
App
Server
Web
Server
Tier 2
DC
Rack
Group
Rack
Placement
Engine
Offeri
ng 3
400
Rack
Rack
Rack
Group
Rack
Rack
Rack
3) Network Access Cost Matrix (Available
Bandwidth / Dynamic Utilization)
Contract
# 889
DC
1
Offeri
ng 2
200
#999
Contract #888
Contract # 888
Offeri
ng 1
Contract #677
Contract
#677
Rack
Group
Contract # 768689
Contract # 78934
300
DC
Tier 3
4) Previous reservations committed & Account
Quotas
Contract
#55
/
2) Resource
Hierarchy
Contract #123
J
a
n
23
Proprietary
Contract #444
D
e
c
DC
2
Rac
k1
DC
3
DC
1
R2
DC
2
R2
DC
3
R3
Rac
k2
Rac
k3
Output:
- Initial Placement
- Run-Time Management
- Defragmentations& Migration
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
4/9/2015
23
基于资源可用状态的分配策略
Packing（填满）
• 应用程序在尽量少的物理服务器上运行
• 每个被使用的服务器利用率最大化，减少资源碎片，减
少能源消耗。
Striping（分散）
• 应用程序分散在尽可能多的物理服务器上运行
• 减少机器故障带来的影响，提高应用程序的运行效率
Load-Aware（基于
负载）
• 新的应用程序总是运行在负载最轻的物理服务器上
• 获得更高的应用程序运行效率
HA-Aware（基于高
可靠性配置）
• 将支持高可靠性（HA）的服务器资源分配给关键业务
• 提供更高的资源可用性
Energy-Aware（节
能）
• 根据节能指数和数据中心热点运行应用程序
• 减少能源消耗
Affinity-Aware（基于 • 将任务分配到与关键资源关联度最高的服务器上，例如
将任务分配到与存储系统直连的服务器上
关联程度）
• 保证应用程序运行效率
Server Model-Aware
（基于服务器类型）
• 根据服务器类型分配资源
• 尽可能利用性能好的、昂贵的资源，是投资回报最大化
Topology-Aware（基 • 尽量使用连接到同一个交换机、背板、刀片中心的服务
器运行用户任务
于网络拓扑）
• 提高应用程序运行效率
24
Proprietary
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
Application-Aware 调度
需求: 动态的调整业务应用对资源的需求改变，而无须修改应用的中间件
输入：
1.系统负载参数(cpu, mem)
2.集成的应用软件效率管理系统
3.需求的调度策略
2
Application
Performance
Manager
Call ISF or send
Alert
3
Get historical
usage
Application
Orchestrator
PTM Framework
Monitor
Grow/Shrink
1
Deploy &
Monitor VMs
P
T
M
ICM
ISF Master
PVMO
KVM Hypervisor
Resource Group
25
Proprietary
Vmware Hypervisor
Resource Group
Physical
Linux Resource Group
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
资产管理与监控
•
•
•
CMDB
Asset
DB
Resource
Updater
API
ISF
•
Add custom attributes
about hosts from 3rd
party tools via API
Attributes can be used in
scheduling & placement
policies
Useful to organize hosts
by location, energy
efficiency, model types,
lease dates
Supports both static and
dynamic attribute updates
Monitoring
DB
26
Proprietary
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
资源使用数据用来做计费和能力规划
HPC Application
Other Data
Reporting App
Platform ISF
External Billing
System
Rate
Definition
27
Proprietary
and Confidential: Platform Computing Corporation
JBOSS App
Usage Data
• Reserved Amount & Time
• On-Demand Amount & Time
• CPU Usage
• Mem Usage
• By Account
• By Application Def
• By User
• By Resource Group
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
存储的集成

适配器来发现存储的内容和生成存储的资
源池

用户使用存储资源就如同使用一个服务的定
义

系统可以预约存储资源

系统启动适配器来生成存储的分配空间

工作流和后置配置步骤用来连接存储服务器
ISF Master
Storage
Adaptor
Storage Containers
Storage Manager APIs (EMC, NetApp)
28
Proprietary
High Performance
2G
10G
5TB
Mid-range storage
5G
10G
100G
Low-end storage
25G
50G
10TB
20TB
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
网络集成
IP Pool Management
ISF
IP Pool 1
IP Pool N
Network Adapter
External Pool
Network Device Adapter
LB
Adapter
Physical
Device
29
Proprietary
and Confidential: Platform Computing Corporation
FW
Adapter
Physical
Device
SW
Adapter
Physical
Device
Physical
Device
Router
Adapter
Physical
Device
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
企业私有云
ISF Market
Place Broker
Application
App
Manager
ISF Master Node
ICM
Portal
End-User
ISF Master Node
CES
ICM
Portal
CES
P-VMO
P-VMO
VMwar
e
Nagios
xCAT
VMwar
e
Nagios
xCAT
West Coast
Data Center
RedHat
Remote
Proxy
Citrix
Remote
Proxy
VMwar
e
Enterprise Messaging Infrastructure / JMS
Blad
eLogic
xCAT
Enterprise DB
Infrastructure
Opswar
e
Amazo
n
VMwar
e
Blad
eLogic
Tivoli
xCAT
Cloud
Admin
Europe
Data Center
East Coast
Data Center
Leverage EGO capabilities to distribute ISF services across multiple nodes and provide
centralized monitoring, troubleshooting, and HA
30
Proprietary
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
Platform Computing, Inc.
Platform
Clusters, Grids, Clouds, Whatever
Computing
The leader in cluster, grid and cloud management software:
o 17 years of profitable growth
o 2,000 of the world’s most demanding client organizations
o 5,000,000 CPUs under management
o 500 professionals working across 13 global centers
o Many Strategic relationships including Dell, Intel, Microsoft,
Red Hat and SAS
31
Proprietary
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
Platform Product Portfolio
Platform Cluster
Platform LSF
Platform MPI
Platform Symphony
Clusters
Grids
Platform ISF
Clouds
Workload Management
Resource Management
Platform Computing
32
Proprietary
and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.
Thank you
www.platform.com
zfb@platform.com
33
Proprietary and Confidential: Platform Computing Corporation
Copyright © 2010 Platform Computing Corporation. All Rights Reserved.