International Telecommunication Union
ITU-T
Grid optimized
Network Control Plane
Dominique Verchere
Distinguished Engineer – Alcatel
Alcatel Contributors:
Olivier Audouin
Bela Berde
Agostino Chiosi
Udo Schaefer
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
Agenda
ITU-T
o Grid Application requirements on Carrier
Networks
o Current practices:
• The overlay case
• Grids – Network Management interconnections
o Practical experiences:
• ARGON and Meta-scheduler
o Levels of Grid Application - Network Control
integration
o Standard Organization Synergy outlooks
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
2
Grid Applications are Shared
ITU-T
o Grids are geographically distributed and connected
by a wide-area network
o Grids are heterogeneous in many Resource aspects:
computing, storage, sensor/instruments
o A collection of Grid services can “dynamically” be
established and then leave the Grid
o Grid Application Servers are shared and accessed
“on-demand” by a set of Grid session through Grid
Middleware services
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
3
Convergent Carrier Networks are Shared
ITU-T
o
o
o
o
Network Infrastructure is a collection of switching
technologies (regions): e.g. Ethernet Wavelength,
SONET/SDH, IP/MPLS and others
Network infrastructures is enabled to provide
different Connectivity Services to its users
Network infrastructure is shared between different
class of application users
Operational Network is able to reconfigure its
connections with its control plane
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
4
Grid Application Requirements on the Connectivity
ITU-T
Network Connectivity services for Grids should rely on:
o Multipoint Connectivity Services
•
o
Inter-Domain Traffic Engineering extensions
•
o
A Grid session can span several Administrative domains
Multi-Switching Capability Connections
•
o
A Grid session interconnect multiple resource end points
A Grid session can be transported by several network
layers and/or cross several network regions
Different Signaling options for Network Resources
•
•
In advance: scheduled bandwidth requests
Real-time: immediate bandwidth provisioning
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
5
Grid Application Requirements on the Network
(con’t)
ITU-T
o
In Most of the cases Grid applications are overlaid on
the Network infrastructure and do not communicate
their QoS requirements:
•
•
o
Dedicated resources or over-provisioning are required to
sustain the highest value of QoS needed
Shared resources and no QoS (best-effort)
Enhancements of Grid ApplicationÆNetwork control
interactions are required to
•
•
•
Allow network control plane to deliver dynamically
connectivity with the correct QoS values
Configure Network according to Grid application needs,
(re)configuration should be fast, accurate and automatic
Orchestrate end-2-end Grid and Network resources
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
6
Overlay Model: No dynamic possible
ITU-TGrid Application User(s)
Company A
Data Center(s)
Enterprise B
Grid Application Network
Request
SOAP/HTTP/TCP/IP
Response
Source UNI-C Data Client Network
UNI-C
Virtual Topology
Destination UNI-C
UNI-C
Transport Network
UNI-N
RSVP
Session A
o
UNI-N
Connectivity Service
Computational/Storage Service
RSVP
Session B
Application Users request Grid Services to the Servers through the
Middleware Application triggering e.g. XML/HTTP/TCP/IP session(s)S
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
7
Specifications for Grid applications to interact
with its transport network
ITU-T
Specifications for more Grid Æ Network interactions:
o Control for resource discovery, resource selection and
signaling is more uniform
o Virtualization for Grid and Network Resources:
• To control the resources allocated during a Grid session
o Grid applications can provide directly their QoS
requirements to shared controlled network
o End-to-end resource cross optimization is enabled:
• end Grid resources: CPU, storage, instruments; and
• network resources: bandwidth with QoS guarantees
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
8
Integrated Model: exploits the control functions
ITU-T
o Integrated (Grid+Network) Control relies on resource
virtualization with combined resource discovery, selection
and reservation
o Coupling Grid Sessions and Connections set-up/release
enable efficient use of the resources at multiple sites
o Grid sessions express its bandwidth needs, and Network
establishes very quickly an exclusive VPN
Grid Network
Client Network
Computer
Clusters
Transport Network
UNI-N
Instrument(s)
UNI-N
UNI
Data Center(s)
Edge Node
Grid Application
(e.g. UNICORE, g-Lite)
A_1
(G)MPLS controlled Network
Edge Node
A_2
Local Network
A_n
Disk_1
Disk_2
.
.
.
Disk_k
Edge Nodes
e-VLBI
.
.
.
Grid Resource Scheduler
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
9
Different levels of
Grid Application /Network interactions
ITU-T
Compendium of architectures and functionality alternatives
o Level 0: Application - Network Resources are disjointedly
controlled: no hook
• End-Hosts solely drive the Grid applications operations on a full
provisioned network
o Level 1: Management plane based system: Grid – NMS
Middleware interactions: “Gateway” hook
• Grid / Connection requests are centralized
o Level 2: Application Control functions – Network Control
functions interactions:
• Grid / Connection Controls are integrated and can be distributed
• Cross-optimization between Grid and Network Resources enabled at
each location and globally
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
10
«Application – Network hook» where ?
ITU-T
Level 0 ?
Level 1 ?
Media Encoding
Network Management
Level 2 ?
DHCP
DNS
RSVP
(S)RTCP
RTP
Application (Web-Service)*
SDP
SOAP
SIP
HTTP
SigComp
reserve/allocate
UDP
TCP/SCTP
use
IPv4 / IPv6
Network Resources
* e.g. GRAAP
possible configuration
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
11
Level 1 example: ARGON - Network Architecture
Allocation and Reservation in Grid-enabled Optic Networks
ITU-T
Multi-Region Network
Overlay Model case:
A7750SR
oo Optical domain is not visible to
IP domain
oo MPLS domain can not perform
efficient TE (two Routing AS)
oo GMPLS UNI signaling
MPLS
A1678MCC
Proxy-UniClient
CLI
Administration
SNMP
Server
ARGON
Alcatel
ASON/GMPLS
DataBase
Listener
GMPLS
Switch
UNI
Controller
Auto
Discovery
RSVP
SNMP
Client
Service
provisioning
MPLS
Switch
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
12
Level 1: Meta-Scheduling Service – Architecture
ITU-T
1) User specifies Job
UNICORE Client
Site A
NJS
Site B
UNICORE
Gateway
UNICORE
Gateway
NJS
Primary NJS
MetaScheduler
2) MetaScheduling
Request
(WS-Agreement)
5) Job transfer to
UNICORE System
4) MetaScheduler
Reply
(WS-Agreement)
Target System
Interface
Target System
Interface
Target System
Interface
Job Queue
Job Queue
Job Queue
Link Usage
Local
Scheduler
Local
Scheduler
Local
Scheduler
Network RMS
Adapter
Adapter
Adapter
Adapter
Cluster
Cluster
Cluster
3) Negotiation
and Reservation
ARGON
6) All Job
Components
including Network QoS
are provisioned
automatically
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
13
Level 1: Multi-Domain Connection Management
ITU-T o Grid sessions span several Administrative Domains
o A set of automated procedures for non-technology specific inter-
domain: AAA, Negotiation, Pricing can be required
o Connection signaling may not be uniform end-to-end precluding
end-to-end controls
User Interface
User Interface
User Interface
Inter-Domain Manager
User Access
Module
AAI
.
Request Handling
Logic
Resource
Modeling
Policy
Modeling
Inter-domain Path
Finder
Inter-Domain Manager
Inter-Domain Manager
User Access
Module
AAI
.
Request Handling
Logic
Resource
Modeling
Policy
Modeling
Inter-domain Path
Finder
User Access
Module
AAI
.
Request Handling
Logic
Resource
Modeling
Policy
Modeling
Inter-domain Path
Finder
Domain Manager
Technology Proxy
Domain Manager
Domain Manager
Technology Proxy
Technology Proxy
NMS
GMPLS Signaling
connection service
SDH
IP/MPLS
GE
Ethernet/GFP-over-SDH
Ethernet-over-IP/MPLS
Grid Application Users
Company A
Native Ethernet VLAN Storage Cluster of
Company B
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
* From Geant2 / Afrodite Sevasti
14
Level 1 Æ 2: Grid Application / Network
Resources Provisioning sequence
ITU-T
o Grid Application requests intercepted by the network controllers
for delivering the connection with the exact QoS
Storage Cluster of
Enterprise B network
Grid Application Users
Request
SOAP/HTTP/TCP/IP
Path(ERO, P-label,) (3)
Source
TE Link
Path(ERO, P-label,…) (6)
Intermediate
Resv (8)
Destination
interactions
Response
Resv (7)
UNI
Path(ERO, WDM-label,...) (1)
Resv… (2)
Path(ERO,WDM-label,… (4)
Resv… (5)
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
15
Level 2: Grid Application Server Discovery
ITU-T
o Joint Resource Advertisements for Grid + Network
o Combination of Grid Application and Network protocol discovery
Grid Server X
li sh
Pub
GSA flooding
Grid Application user I
R1
R3
Network = Connection + Grid Resource
Broker
Publish
d
Fin
R2
R4 Publ
i sh
er
ov
sc
i
D
Grid Application user J
Grid Server Y
Grid Session Configuration
Grid Server Z
Building a GS-DB
Grid
Grid Server
ServerTable
Table
Grid Server State Database
Grid Session Tree
R2
GRC
R4
R1
Algorithm
R3
Sx
Sy
Sz
Flooding of Grid Server-State information
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
16
Level 2: Grid aware Network Resource Signaling
ITU-T
o Joint Signaling for Grid + Network Resource Reservation
o Combination of Grid Application and Network protocol signaling
to accommodate Grid information Resource Request/Reserve
message exchanges
Storage Cluster of
Enterprise A network
Grid Session Y resource signaled:
Storage:
Local HD: 250TBytes
Back-up: 500GBytes
Encryption: h igh
Storage Cluster of
Enterprise B netwo rk
Co mputer Cluster of
Enterprise A network
Tra nsport N etwor k
(G)MPLS
Lx- LSP_1
Grid Session X resource signaled:
Co mputer:
#of CPUs: 32
CPU processing: 1 Gh z
CPU Memory : 500 M Bytes
Storage:
Local HD: 50GBytes
Back-up: 50GBytes
Encryption: h igh
Visualizat ion
Co mpany X netwo rk
Co mputer Cluster of
Enterprise C
Lx- LSP_3
Lx- LSP_2
Gri d Session X
Lx- LSP_3
Gri d Session Y
Grid Application
Signaling
Grid Application +
Network Signaling
Grid Application
Signaling
Research labs
Co mpanyand
Y network
ITU-T/OGF Workshop on Next Generation Networks
Grids
Geneva, 23-24 October 2006
17
Standards Organizations and Fora Working on
Control Network Standards or Specifications
ITU-T
ITU-T
Rec.s
•Architecture
•Protocols
•Management
RFCs
•Protocols
MTNM
Spec.s
Impl.
Agreemt.
•Protocols
•Info Model
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
18
OGF: Open Grid Services Architecture
and its Control functions
ITU-T
Execution
ExecutionManagement
Management
Data
DataServices
Services
•• Job
Jobdescription
description&&submission
submission
•• Scheduling
Scheduling
•• Resource
Resourceprovisioning
provisioning
•• Common
Commonaccess
accessfacilities
facilities
•• Efficient
&
reliable
Efficient & reliabletransport
transport
•• Replication
Replicationservices
services
Resource
Resource
Management
Management
Self-Management
Self-Management
•• Discovery
Discovery
•• Monitoring
Monitoring
•• Control
Control
OGSA
OGSA
Information
Information
Services
Services
•• Self-configuration
Self-configuration
•• Self-optimization
Self-optimization
•• Self-healing
Self-healing
Security
Security
•• Cross-organizational
Cross-organizationalusers
users
•• Trust
Trustnobody
nobody
•• Authorized
Authorizedaccess
accessonly
only
•• Registry
Registry
•• Notification
Notification
•• Logging/auditing
Logging/auditing
OGSA
OGSA“profiles”
“profiles”
Web
Webservices
servicesfoundation
foundation
From: «OGF Standards Activity» - Steven
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
Newhouse
19
Any Level of Integration requires Synergies
ITU-T
o Control Integration raises Scalability issues
• Performance associated messaging / processing have
to be carefully analyzed for design
• Grid Session Dynamic constraints are not uniform
o Integrated approach enables distributed Control
capabilities for Grid Applications and Networks
• Rapid, Flexible and Uniform
o Uniform Control enables richer interactions
between the Network and the Grid applications
o Liaisons / Synergies between the Standard organizations are needed and will have to be established
ITU-T/OGF Workshop on Next Generation Networks and Grids
Geneva, 23-24 October 2006
20