Today
Cloud Concepts
Amazon Web Services overview
Amazon EC2
Amazon S3
Amazon SQS
Application Architecture
Questions
Who am I?
IT Infrastructure development
15 Years in the Industry:
Veteran of several startups
Former Manager IT &
Cloud Services at Folio3
Cloud Infrastructure Architect
at 10Pearls
What is Cloud??
What is Cloud??
What is Cloud??
Amazon Web Services Are...
A set of APIs and business models which give
developer-level access to Amazon’s infrastructure
and content:
Data As A Service
Amazon E-Commerce Service
Amazon Historical Pricing
Infrastructure As A Service
Amazon Simple Queue Service
Amazon Simple Storage Service
Amazon Elastic Compute Cloud
Search As A Service
Alexa Web Information Service
Alexa Top Sites
Alexa Site Thumbnail
Alexa Web Search Platform
People As A Service
Amazon Mechanical Turk
7
AWS Cloud
Amazon Simple Storage Service
• Object-Based Storage
• 1 B – 5 GB / object
• Fast, Reliable, Scalable
• Redundant, Dispersed
• 99.99% Availability
Goal
• Private or Public
• Per-object URLs & ACLs
• BitTorrent Support
$.15 per GB
per month
storage
$.01 for 1000 to
10000 requests
$.10 - $.18 per
GB data transfer
Amazon S3 Concepts
Objects:
Opaque data to be stored (1 byte … 5 Gigabytes)
Authentication and access controls
Buckets:
Object container – any number of objects
100 buckets per account / buckets are “owned”
Keys:
Unique object identifier within bucket
Up to 1024 bytes long
Flat object storage model
Standards-Based Interfaces:
REST and SOAP
URL-Addressability – every object has a URL
S3 SOAP/Query API
Service:
ListAllMyBuckets
Buckets:
CreateBucket
DeleteBucket
ListBucket
GetBucketAccessControlPolicy
SetBucketAccessControlPolicy
GetBucketLoggingStatus
SetBucketLoggingStatus
Objects:
PutObject
PutObjectInline
GetObject
GetObjectExtended
DeleteObject
GetObjectAccessControlPolicy
SetObjectAccessControlPolicy
Amazon Simple Queue Service
SQS
Amazon Simple Queue Service
• Scalable Queuing
• Elastic Capacity
• Reliable, Simple, Secure
$.10 per 1000
messages
Inter-process messaging, data
buffering, architecture
component
$.10 - $.18 per
GB data transfer
Amazon SQS Concepts
Queues:
Named message container
Persistent
Messages:
Up to 256KB of data per message
Peek / Lock access model
Scalable:
Unlimited number of queues per account
Unlimited number of messages per queue
Amazon SQS At Work
SQS SOAP/Query API
Queues:
ListQueues
DeleteQueue
SetVisibilityTimeout
GetVisibilityTimeout
Messages:
SendMessage
ReceiveMessage
DeleteMessage
PeekMessage
Security:
AddGrant
ListGrants
RemoveGrant
Amazon Elastic Compute Cloud
EC2
Amazon Elastic Compute Cloud
• Virtual Compute Cloud
• Elastic Capacity
• 1.7 GHz x86
• 1.7 GB RAM
• 160 GB Disk
• 250 MB/Second Network
• Network Security Model
Time or Traffic-based Scaling, Load
testing, Simulation and Analysis,
Rendering, Software as a Service
Platform, Hosting
$.10 per
server hour
$.10 - $.18 per
GB data transfer
Amazon EC2 Concepts
Amazon Machine Image (AMI):
Bootable root disk
Pre-defined or user-built
Catalog of user-built AMIs
OS: Fedora, Centos, Gentoo, Debian,
Ubuntu, Windows Server
App Stack: LAMP, mpiBLAST, Hadoop
Instance:
Running copy of an AMI
Launch in less than 2 minutes
Start/stop programmatically
Network Security Model:
Explicit access control
Security groups
Inter-service bandwidth is free
Amazon EC2 At Work
Startups
Cruxy – Media transcoding
GigaVox Media – Podcast Management
Fortune 500 clients:
High-Impact, Short-Term Projects
Development Host
Science / Research:
Hadoop / MapReduce
mpiBLAST
Load-Management and Load Balancing Tools:
Pound
Weogeo
Rightscale
EC2 SOAP/Query API
Images:
RegisterImage
DescribeImages
DeregisterImage
Instances:
RunInstances
DescribeInstances
TerminateInstances
GetConsoleOutput
RebootInstances
Keypairs:
CreateKeyPair
DescribeKeyPairs
DeleteKeyPair
Image Attributes:
ModifyImageAttribute
DescribeImageAttribute
ResetImageAttribute
Security Groups:
CreateSecurityGroup
DescribeSecurityGroups
DeleteSecurityGroup
AuthorizeSecurityGroupIngress
RevokeSecurityGroupIngress
Sample Web-Scale Architecture
GigaVox Media
Web-Scale Architecture
GigaVox Economics
Implemented Amazon S3, Amazon EC2 and
Amazon SQS in November 2006
Created an infinitely scalable
infrastructure for less than $100 - building
the same infrastructure themselves would
have cost thousands of dollars
Reduced staffing requirements - far less
responsibility for 24x7 operations
Q&A
Thank You!
Jeff Barr
Senior Web Services Evangelist
jbarr@amazon.com
Pointers
Portal
http://aws.amazon.com
Blog
http://aws.typepad.com
EC2
http://aws.amazon.com/ec2
S3
http://aws.amazon.com/s3
Resource Center
http://aws.amazon.com/resources
Forums
http://aws.amazon.com/forums