Market-Oriented Cloud Computing: Vision, Hype, and

advertisement
Market-Oriented Cloud Computing:
Vision, Hype, and Reality for Delivering IT
Services as Computing Utilities
Rajkumar Buyya(1,2), Chee Shin Yeo(1), and Srikumar Venugopa(l)
1.Grid Computing and Distributed Systems (GRIDS) Laboratory Department of
computer Science and Software Engineering
The University of Melbourne, Australia
2.Manjrasoft Pty Ltd, Melbourne, Australia
HPCC '08. 10th IEEE
1
Outline









2
Introduction
Market-Oriented Cloud Architecture
Commercial offering of market-oriented Clouds requirement
and Qos issue
Emerging cloud platform
Amazon EC2 intro&pricing
Google App Engine intro&pricing
Microsoft Anzure platform intro&pricing
Possible pricing strategy(by Ming Lung)
Conclusions&comments
Introduction:definition
Definition of cloud:
 A Cloud is a type of parallel and distributed system;
 Consisting of a collection of interconnected and
virtualized computers



3
That are dynamically provisioned and presented as one or
more unified computing resources
,based on service-level agreements established through
negotiation between the service provider and consumers.”
Introduction:trend
Web Search Trends:

[C]. Google and Salesforce.com in Cloud computing deal, Siliconrepublic.com - Apr 14 2008
4
Market-Oriented Cloud Architecture

Cloud providers will need to consider and meet different
QoS parameters of each individual consumer as
negotiated in specific SLAs.

Traditional system-centric resource management
architecture are no longer fit
5

Do not provide incentives for them to share their
resources.

Regard all service requests to be of equal importance.
Market-Oriented Cloud Architecture
6
Market-Oriented Cloud Architecture
Service Request Examiner and Admission Control:


Interprets the submitted request for QoS requirements before
determining whether to accept or reject the request.
Pricing:


The Pricing mechanism decides how service requests are
charged.
 Ex. submission time (peak/off-peak)
, pricing rates (fixed/changing)
Accounting:


Maintains the actual usage of resources by requests and
historical information usage.


7
Final cost to charge users.
Improve resource allocation decisions.
Market-Oriented Cloud Architecture

VM monitor:
 Keep track of the availability of VMs and their resource
entitlements.

Dispatcher:
 starts the execution of accepted service requests
on allocated VMs.
 Service Request Monitor:

8
keeps track of the execution progress of service
requests.
Qos parameter issue

In cloud there are critical QoS parameters to consider in
a service request




time, cost, reliability and trust/security.
In particular, QoS requirements cannot be static and need
to be dynamically updated over time.
 Due to continuing changes in business operations
and operating environments.
But , there are no or limited support for dynamic
negotiation of SLAs.
Recently, we have developed negotiation mechanisms
based on alternate offers protocol for establishing SLAs
[8].
9 [8]S.Venugopal, X. Chu, and R. Buyya. using the Alternate Offers Protocol (IWQoS 2008), A Negotiation Mechanism for Advance
Resource Reservation
Commercial offering of market-oriented
Clouds requirement

Customizable

Support customer-driven service management based on
customer profiles and requested service requirements.

Market-based resource management
 Contain computational risk management to sustain SLAoriented resource allocation.

Incorporate autonomic resource management models:

10
Effectively self-manage changes in service requirements to
satisfy both new service demands and existing service
obligations.
Emerging cloud platform
11
Amazon EC2
12
Amazon EC2


Instances Types (Memory / *ECU / Storage / Platform)
Standard Instances




High-Memory Instances



Small (default): 1.7 GB / 1 / 160 GB / 32-bit
Large: 7.5 GB / 4 / 850 GB / 64-bit
Extra Large: 15 GB / 8 / 1690 GB / 64-bit
Double Extra Large: 34.2 GB / 13 / 850 GB / 64-bit
Quadruple Extra Large: 68.4 GB / 26 / 1690 GB / 64-bit
High-CPU Instances


Medium: 1.7 GB / 5 / 350 GB / 32-bit
Extra Large: 7 GB / 20 / 1690 GB / 64-bit
13
http://aws.amazon.com/ec2/
About Measuring Compute Resources
(quote from Amazon)


*ECU – EC2 Compute Unit, providing the equivalent CPU
capacity of a 1.0 – 1.2 GHz 2007 Opteron or 2007 Xeon
processor
“Amazon EC2 uses a variety of measures to provide each
instance with a consistent and predictable amount of CPU
capacity.”



We use several benchmarks and tests to manage the consistency and
predictability of the performance of an EC2 Compute Unit.
Over time, we may add or substitute measures that go into the
definition of an EC2 Compute Unit, if we find metrics that will give
you a clearer picture of compute capacity.
“To find out which instance will work best for your application,
the best thing to do is to launch an instance and benchmark
your own application.”

14
pay by the hour
On-Demand Instances
US – N.Virginia
EU – Ireland
Standard Instances
Linux/UNIX
Windows
Linux/UNIX
Windows
Small (default)
$0.085
$0.12
$0.095
$0.13
Large
$0.34
$0.48
$0.38
$0.52
Extra Large
$0.68
$0.96
$0.76
$1.04
High-Memory Instances
Linux/UNIX
Windows
Linux/UNIX
Windows
Double Extra Large
$1.20
$1.44
$1.34
$1.58
Quadruple Extra Large
$2.40
$2.88
$2.68
$3.16
High-CPU Instances
Linux/UNIX
Windows
Linux/UNIX
Windows
Medium
$0.17
$0.29
$0.19
$0.31
Extra Large
$0.68
$1.16
$0.76
$1.24
Unit: Per Hour
15
Reserved Instances
Linux/UNIX
One-time fee
US – N.
Virginia
US – N.
California &
EU – Ireland
Standard Instances
1 yr
3 yr
Usage ( /hr)
Usage ( /hr)
Small (default)
$227.50
$350
$0.03
$0.04
Large
$910
$1400
$0.12
$0.16
Extra Large
$1820
$2800
$0.24
$0.32
High-Memory Instances
1 yr
3 yr
Usage ( /hr)
Usage ( /hr)
Double Extra Large
$3185
$4900
$0.42
$0.56
Quadruple Extra Large
$6370
$9800
$0.84
$1.12
High-CPU Instances
1 yr
3 yr
Usage ( /hr)
Usage ( /hr)
Medium
$455
$700
$0.06
$0.08
Extra Large
$1820
$2800
$0.24
$0.32
16
Spot Instances

Spot Instances enable you to bid for unused Amazon EC2 capacity.

To use Spot Instances, you should set

(instance type, region, amount, maximum price)
US – N.Virginia
EU – Ireland
Standard Instances
Linux/UNIX
Windows
Linux/UNIX
Windows
Small (default)
$0.085
$0.12
$0.095
$0.13
Large
$0.34
$0.48
$0.38
$0.52
Extra Large
$0.68
$0.96
$0.76
$1.04
High-Memory Instances
Linux/UNIX
Windows
Linux/UNIX
Windows
Double Extra Large
$1.20
$1.44
$1.34
$1.58
Quadruple Extra Large
$2.40
$2.88
$2.68
$3.16
High-CPU Instances
Linux/UNIX
Windows
Linux/UNIX
Windows
Medium
$0.17
$0.29
$0.19
$0.31
Extra Large
$0.68
$1.16
$0.76
$1.24
17 *fluctuates periodically depending on the supply of and demand for Spot Instance
Data Transfer
Internet Data Transfer
Data Transfer In
All Data Transfer
Free through June 30, 2010*
Data Transfer Out
First 10 TB per Month
$0.17 per GB
Next 40 TB per Month
$0.13 per GB
Next 100 TB per Month
$0.11 per GB
Over 150 TB per Month
$0.10 per GB
Data transferred between two Amazon Web Services within the same zone is
free of charge.
Data transferred between AWS services in same regions but different zone will
be charged $0.01 per GB in/out.
18
Amazon add-on services

Amazon Elastic Block Store



Amazon EBS volumes provide off-instance storage that persists
independently from the life of an instance.
Charged per GB/month and I/O request
Amazon CloudWatch (bundle with Auto Scaling)

Amazon CloudWatch is a web service that provides monitoring for
AWS cloud resources.




such as CPU utilization, disk reads and writes, and network traffic.
Auto Scaling allows you to automatically scale your Amazon EC2
capacity up or down according to conditions you define.
Charged per instance-hour
Elastic Load Balancing


19
Elastic Load Balancing automatically distributes incoming application
traffic across multiple Amazon EC2 instances.
Charged per hour and GB of data processed
Google App Engine
20
Google App Engine



Run web applications on Google’s infrastructure
Programming language support: python, java
Pricing:

Quota

Fixed quota (for free)




Disable billing
Enable billing
Billable quota
Budget
http://code.google.com/intl/en/appengine/docs/whatisgoogleappengine.html
21
Requests
22
Datastore
23
URL Fetch
24
Mail
25
Image Manipulation
26
Memcache
27
Billable Quota Unit Cost
http://code.google.com/intl/en/appengine/docs/billing.html
28
Microsoft Windows Azure
29
Microsoft Windows Azure

Windows Azure platform


Provides a scalable environment with compute, storage, hosting,
and management capabilities.
SQL Azure

30
A Relational Database for the Cloud(Windows Azure
platform).
Microsoft Windows Azure

During Community Technology Preview (CTP), services
included in Windows Azure will be available without
charge




Total compute usage: 2000 VM hours/month
Cloud storage capacity: 50GB
Total storage data transfers: 20GB/day
Once launched for commercial use, Windows Azure
would be priced and licensed


31
Jan 1, 2010
First month without charge
Pricing unit

Compute Instances:


(Instance Size, CPU, Memory, Storage, I/O Performance )
Small --------1.6 GHz ,1.75 GB, 225 GB, Moderate
Medium --2 x 1.6 GHz , 3.5 GB, 490 GB, High
Large----- 4 x 1.6 GHz, 7 GB, 1,000 GB, High
Extra large-8 x 1.6 GHz, 14 GB, 2,040 GB, High
Instance hour transformation:

32
Instance Size
1 hour
Medium
Large
Extra large
Elapsed Hour Small Instance Hours Small
1 hour
1 hour
2 hours
1 hour
4 hours
1 hour
8 hours
Pricing

Consumption:





Compute = $0.12 / small instance hour
Storage = $0.15 / GB stored / month
Storage transactions = $0.01 / 10K
Data transfers = $0.10 in / $0.15 out / GB - ($0.30 in / $0.45
out / GB in Asia)
Reserved(Development Accelerator Core):





33
750 hours (small compute instance)
10 GBs of storage
1,000,000 storage transactions
7 GB in / 14 GB out(2.5 GB in / 5 GB out in Asia)
For 6 month = $59.95 (42% off from consumption)
Pricing



Web Edition: Up to 1 GB relational database = $9.99 /
month
Business Edition: Up to 10 GB relational database =
$99.99 / month
Data transfers = $0.10 in / $0.15 out / GB - ($0.30 in /
$0.45 out / GB in Asia)
34
Possible Strategies

Cost-based pricing





35
Flat pricing
Tiered-pricing
Performance-based pricing
User-based pricing
Usage-based pricing
Possible Strategies
Amazon
EC2
Google App
Engine
Windows
Azure
Low-price leader
O
O
O
Experience-curve pricing
?
Bundling
O
O
Price signaling
Reference pricing
?
Image/prestige pricing
O
O
O
Cost-plus pricing
Complementary pricing
Premium pricing
Random discounting
?
Periodic discounting
?
Second-market discounting
36
*
Possible Strategies

Other effects

37
Similar prices (competing situation?)
Conclusion&Comments



In this paper, we have proposed architecture for marketoriented allocation of resources within Clouds.
We have discussed some representative platforms for
Cloud computing covering the state-of-the-art.
Comments:


38
This paper has a simple but clear architecture that we can use.
(need add something detail)
Some of the information of the cloud platform are out of date,
but the comparison is good.
Download