Open Grid Services Architecture
Framework for Grid Service evolution
Jeff Nick, IBM Fellow
Director, Advanced Systems Architecture
jnick@us.ibm.com
5.30.02
1
OGSA Framework.prz
Grid Evolution
Grid: Transparent, secure and coordinated computing resource sharing
across sites - a "cluster of clusters"
Scope of Sharing
Service Grid: supported by xSPs
Partner Grid: across multiple organizations
GM, DoD HPC, NASA IPG, UK Grid, …
Enterprise Grid: inter-dept sharing within orgs
TI, Toshiba, GM, Monsanto, …
S&TC Grid
Adoption over time
2
OGSA Framework.prz
Services model
Separate interface from access and implementation
Interface
Local/Remote
Transparency
Service implementation
3
WSDL
Bindings
Adaptation layer
Execution Container
OGSA Framework.prz
Native platform function
Commercial Grids via OGSA
"Differences are fundamentally ones of organizational
configuration, isolation and policy control, not architectural"
Common Resource Management Services
Local/Remote Transparency
Enterprise A
Gold
Grid
4
Enterprise B
Brown
Grid
Native Platform Resource Management Integration
OGSA Framework.prz
Red
Grid
OGSA Service Model
Web services does not an OGSA service make!
All services adhere to specified OGSA service
interfaces and behaviors (some required and some
optional)
Factory, registry, discovery, lifecycle, query
service data, notification, reliable invocation
A robust abstract services component model,
where resources are rendered as services and
composable
Reliable and secure preservation of distributed
state
Supports dynamic late-binding and creation of
distributed resource groups
5
OGSA Framework.prz
OGSA Common QoS Functions
Interface
...
Distributed Security Services
Distributed Log Services
Bindings
Distributed Trace Services
Domain Management Services
Database Abstraction Services
Distributed Cluster Services
Policy and Repository Services
Resource Instrumentation Services
6
OGSA Framework.prz
Implementation
Architecture Framework
http://www.globus.org/research/papers/ogsa.pdf
S&TC
xSP
eCommerce
etc...
End-Users and Admin Staff
New classes of applications enabled
Common GUI
eLiza Autonomic Functions & Management Middleware
Open Grid Services Architecture
WebServices run-time
IBM Platforms QoS Enablers/Optimizers
z/OS
AIX
OS/400
Linux
zSeries
pSeries
iSeries
z,p,i,xSeries
Windows Storage
xSeries
eServer Foundation
7
OGSA Framework.prz
Solaris
&
HP/UX
Sun
& HP
Linux
Windows
Dell
Compaq
...
Network
Storage
Cisco
Nortel
...
Veritas
...
eBusiness
S&TC
xSP
etc.
New classes of applications and Grid's
End-Users and Admin Staff
IBM
Solutions
Console
eWorkload
eServer
eDisaster
eAutomation eUtility eCluster
Management Management
Management Recovery
OGSA Domain Services
OGSA Meta-OS Services
Data
Replication
Policy
Resource
Instrumentation
Problem
Determination
Logging
Provisioning
Service
Collections
OGSA Infrastructure
Discovery
Lifecycle
Registry
Manageability
(serviceData+)
.NET(?)
Factory
HandleMap
JBOS
z/OS
AIX
OS/400
Linux
Windows
Storage
zSeries
pSeries
iSeries
z,p,i,xSeries
xSeries
Shark
Solaris
&
HP/UX
Sun
& HP
IBM eServer Foundation
Networking Devices, PDAs, .. etc.
OGSA Framework.prz
Notification
WS-Security
IBM Platforms QoS Enablers/Optimizers
8
Platform
Globus
Entropia
Avaki
CA BMC others
IBM eLiza Autonomic Functions & Management Middleware Non-IBM Middleware
Clustering
Install
Config
Deployment
Maintenance
Tivoli
(xSM)
Linux
Windows
Dell
Compaq
...
Network
Storage
Cisco
Nortel
...
Veritas
...
WSAD OGSA Service Plug-in's
Common GUI
Platform Unique
Common
OGSA build-out
Grid Security Characteristics
Hetereogenous Distributed Environment
Common security requirements
Middleware (WebSphere, Lotus, Tivoli, DB2)
Server platform (NT, AIX, Solaris, Linux, zOS,
OS/400)
Federated Security
Federated Identity
Federated Trust
Identity Management
9
Application of Web services security
End-to-end security
OGSA Framework.prz
Categorizing Security
Securing Grid Services
Security Bindings
Credential Propagation
Authentication mechanism
Authorization
Integrity
Confidentiality
Privacy
Grid Security Services
Authentication or Identity Service
Identity Mapping
Authorization
Profile/Wallet, Audit, Notary
10
OGSA Framework.prz
OGSA Common Resource Model
The OGSA Resource
Can be an abstract representation of
real IT Resources
Node, Process, Interface Adapter, Disk,
Filesystem, IP Address
common event
notification
Can be an abstract representation of
a logical IT Resource
compositions of real IT Resources to build services
and complete business applications
Provides some common operations
Can support multiple underlying
resource models
Generic Resource
States
such as CIM or SNMP
Resources are Service Instances
common resource
attribute query
common lifecycle mgmt
11
common resource
discovery
OGSA Framework.prz
OGSA Manageability Architecture
Resource Instrumentation Consumer (e.g.
Management Tool)
OGSA Services interface
OGSA environment
OGSA Registry
(contains
Resource
information as
services)
OGSI Register
User-specified PortTypes used
for Resource manipulation
ServiceData (Dependencies,
Lifecycle qual.)
OGSI Service (OGSI Component Model compliant)
Resource Information Provider
Impl.
Impl.
J2EE Resource Instrumentation Connectors
SNMP
CIM
WMI
JMX
API/Script
Resource Instrumentation environments
SNMP
CIM
WMI
JMX
Managed Resources
12
OGSA Framework.prz
Native
Grid Data Services
Goal: transparent interoperation
- connect
- schema
Should tie to other relevant standards
SQL/MED, esp.
Work with UK Data Group, GGF
- query
- notification
- transactions
- bulk loading
- etc.
replication
Integrate with OGSA
13
federation
system status
context mgmt
security
accounting
OGSA Framework.prz
Service
Implementation
e.g.,
File System,
DBMS,
Search Engine
Reporting as Persistent Messaging
Producers generate log messages
Consumers receive/retrieve log messages
Problem determination (post-mortem)
Monitoring (real-time)
Accounting, auditing
Transactional logging ?
Other
Filtering
Message selection criteria
Persistency
Queriable repository of log messages
Supports message polling
Stager
Message queue and message push
14
OGSA Framework.prz
Filter
New
services
Persistent messaging services
Message
Producer
Persistency
Stager
Message
Consumer
4
Grid Services Domain Requirements
Service Routing
reliable brokering/proxying for system and business services
automatic selection based on QoS/SLA (ND, WLM, ... based)
clustering of self healing/discovering services
Service Interoperation
.NET, Java, and other computing model clients and services
automatic client invocation of local/remote services
Service Sharing & Aggregation
sharing & scaling of system services
state management
relationship & exception handling (including unplanned JIT changes)
feed and care of real-time Microflow and Workflow interaction
Service Mapping/Transformation
Service Provisioning
Service Flow & Distribution
Service Security, Version, Deployment. etc.
Service Management
.......
15
OGSA Framework.prz
The Registration and Discovery Architecture:
"Service Desk"
incoming
msg req
private
Registry
Service
Desk
provided
services
outgoing
msg rsp
OGSI
CSEP - Common
Service Entry Point
for a cluster of
services: known url,
WSDL described,
UDDI discoverable
Service
Dispatch
enabling system OGSA Services
Middleware Computing Resources
Autonomic Service Routing
Concealed Complexity
Integration of Web Services and Grid
16
OGSA Framework.prz
Path to Open Collaboration
Work with standards bodies to
define the distributed services needed...
...Accelerate delivery through partners
OSA
Globus/IBM
Market Presence
- Ad Hoc Standard
- GGF open standard
OGSA
Platform/Avaki
Entropia/Microsoft/
Universities/Research/...
IETF ...... W3C ...WS-I... GGF....
17
OGSA Framework.prz
OGSA value proposition
what one wants to build
VALUE-ADD
RAS , Failover,
Data Replication
what one has to build
Abstract resource models,
dynamic discovery and access
Security and Policy
Robust runtime environment
Management of Iifecycle and distributed state
18
OGSA Framework.prz
Grid Computing and OGSA
Storage
Processing
Data
I/O
Applications
Operating System
One virtual, distributed computing platform,
'limitless' global resources
19
OGSA Framework.prz