CAlcul Réparti sur Réseau Internet Optique à CApacité Surmultipliée*
Grid vs. Cloud Computing and Why This Should Concern
the Optical Networking Community
OFC/NFOEC 2009
« Virtualizing and Scheduling Network resource for
Emerging IT services: the CARRIOCAS approach »
Pascale Vicat-Blanc Primet (INRIA) Dominique Verchère (Alcatel-Lucent Bell Labs)
March 23rd 2009
Optical Fiber Communication Conference and Exposition &
the National Fiber Optic Engineers Conference
* Distributed/Grid Computing services delivered by Internet Optical Networks with Ultra-high transmission Capacities
Vx/N&N/E/09/xxx
1
Contents
1. CARRIOCAS Challenges and Project presentation
Cliquez pour modifier le style du titre
2. Efficient Network architecture combining capacity and flexibility
3. Scheduling, Reconfiguration & Virtualization (SRV) service
4. CARRIOCAS Pilot Network and Experimentations
5. Conclusion
2
CARRIOCAS Challenges
 To research, design and implement a ultra-high bit rate
network reconfigurable according to grid applications
Cliquez
pour modifier le style du titre
connectivity
requirements
 Transmission capacity 40Gbit/s per wavelength*
 Enhanced application-network interactions with SRV
 Guarantied network service deliveries in function of
Application QoS requirements.
 To develop new Services & Usages
 collaborative engineering on virtual prototypes
 Computing Intensive Simulation Applications
 interactive visualization
 To specify new business models of services
integrating IT access and connectivity
The 40Gb/s transponder prototypes have been successfully deployed on Bruyères-le-ChâtelSaclay
and SaclayClamart links, performance are at nominal level.
3
CARRIOCAS Partnership
Optics
Networking
Industrials
Computing
Application
SME’s
Academia
Cliquez pour modifier le style du titre
Oct 2006-Sept 2009
LIST
Financial partners:
4
CARRIOCAS Service optimized Optical Network
dimensioning and sizing

Network Traffic flow characterizations «Data Grid» generated by large
organizations (companies and institutions) users (clients) and datacenters
(IT resource providers)
Relative Cost comparisons over 2007 - 2012
Cliquez pour modifier
le style du titre
Tbps
6
-
40.00
-
35.00
-
30.00
-
25.00
-
20.00
-
15.00
-
10.00
5.5
5
4.5
4
3.5
Traffic Evolution
3
2.5
2
1.5
(°)
(*)- 5.00
1
0.5
0
- 0.00
2007
2008
Router over Photonic X-Connect


2009
2010
Year
2011
2012
Carrier Ethernet Switch over Photonic X-Connect
Router over SDH X-Connect
Carrier Ethernet Switch over SDH X-Connect
Router over WDM
Carrier Ethernet Switch over WDM
Carrier Grade Ethernet Switch over SDH X-Connect(°)
TSS over ROADM: CARRIOCAS based architecture (*)
 Layer 2 (Carrier Grade Ethernet) and Layer 1 (WDM) reconfiguration capabilities
 Most Scalable Solution absorbing the increases of data grid traffic demands
5
Towards Virtualized Infrastructures and
«Extended Service Providers»
Usage SLA
Specific Software
(AppsResources)
Grid Service
Cliquez pour
modifier le style du titre
Service Storefront
High Energy Physic
engineers
Bio-informatics Scientists
Provider
CPU Resources
Storage Resources
Provider SLA
Picture Walls
(Visualization
Resources)
Scientific
Instruments/Sensors
(Acquisition
Resources)
Service Integrator &
Presentation
Car Designers –
Manufacturers
Connectivity Services
Network Service Management (S.R.V.)
P
P
CE
Customers
(Enterprises)
!
Provider Edge Node (PE)
PE
UNI
Provider Node (P)
P
UNI
P
P
PE
CE
IT infrastructures
!
Edge Nodes
Provider Edge Node
(G)MPLS controlled Network
Telecom Infrastructure Operator
!
Customer Edge node (CE)
!
Datacenter
Operators 6
CARRIOCAS services suited for Grid
Applications
V1 : Connectivity services
 Requirements: to guarantee Quality of Experiences for grid application users
 Adaptive connections
configurations
withmodifier
QoS guaranteele
(bandwidth,
Cliquez
pour
style latency,
du titre
availability …) negotiated according to Grid Application workflow needs
 Technology enabler: GMPLS, PCE, Timed based Network management

V2 : Full Virtualized services
 Requirements: To integrate grid resources management for executing



the Grid Application workflows
Selection, reservation and interconnection of Computational, Storage
and Visualization Centers which may come from 3rd party resource
infrastructure providers (e.g. datacenters, HPC-centers)
Co-selection and cross-optimization of network and grid (application)
resources
Technology enablers: WSRF, and network protocols
+ VXDL & VXcore (INRIA),
7
Binding of VISUPIPE flows (jobs) and
Carrier Grade Networks services (resources)
 Visualization pipeline partitioning and mapping on Grid IT Resources
Data Source
Raw data
Filtering
Filtered data
Data transformation:
Volumetric transfer function,
Surface construction
Transformed
data
Rendering
Frame
buffer
Display
Cliquez pour modifier le style du titre
3D
3D
Cluster File System
3D
3D
3D
3D
3D
3D
3D
3D
3D
3D
3D
3D
3D
3D
 24 Mpixels x 32 bits x 30 images/s x 2 for stereo = 46,08 Gb/s
 Low latency requirements for interactivity
 One Data flows can be mapped on one EVC allocated on dedicated WDM
Automatic end-to-end Ethernet Virtual Circuit provisioning
PSC TE Link ⇔ WDM FA-LSP
Dynamic mapping
(CE-VLAN)
Mapping
(CE-VLAN)
TSS Add/Drop Ports
WDM LSP
TSS Add/Drop Ports
PSC
[PSC,WDM]
TE-link
Transport Service Switch
OCh
[WDM,WDM] TE-link
(Ingress ROADM)
PSC
OCh
[WDM,WDM] TE-link
[WDM, PSC]
TE-link
(Egress ROADM)
Automatic Switched Optical Network
Transport Service Switch
8
SRV position in Telecom Network
C in/out =20Gbps
Scheduling, Reconfiguration &
Virtualisation
Service
ServiceNegotiation
Negotiation
Service
ServicePublication
Publication
//Notification
Notification
Patterns
Patterns
(WSLA)
(WSLA)
C
Service Provider ’s Carrier Network
S.R.V.
A
NE
Business view
Cliquez pour
SRVmodifier le style du titre
Policies
Policies
Service
ServiceSelection
Selection
Composition
Composition
Virtualized Services (v2)
Contracts
Contracts
Scheduling
Scheduling
A in/out =20Gbps
B in/out =40Gbps
Processes
Processes
B
Shared
SharedInformation
Information//Data
DataModel
Model
Resource
Resourceabstraction
abstraction//Virtualization
Virtualization
Commercial Filters (policies)
Service
Connectivity Services (v1)
Provider
’s Carrier Network
C in/out =2 0Gbps
A
Requests / Reponses Cds
NE
NE
Ain/out
=20Gbps
NE
Bin/out
Management :
Read / Write
Network
Res. Scheduler
Scheduled Management Components of
Network Resources
Scheduled
PCE
NetConf.
Timed
TED
Service
Consultation
=20Gbps
C
Network view
3
NE
2
NE
B
Resource inventory
E
Synchronization/
Alimentation
TED
IGP-TE
NE
D
Service
Provider
’s Carrier Network
NE
A
NE
A in/out =20Gbps
C in/out =2 0Gbps
NE
C
NE
NE
B
Transport Networks
B
Cin/out
NE
B in/out =4 0Gbps
NMS
NE
’s Carrier Network
NE
A in/out =20Gbps
Connection
inventory
NE
Provider
NE
Planning
tools
A
=40Gbps
B
A
Network Management Function Layer
Service view
C
NE
B in/out =4 0Gbps
Element view
NE
C
9
CARRIOCAS Demonstration platform
CARRIOCAS pilot network demonstrates advanced network service functions and
proving their concepts through an emulation platform
Cliquez pour modifier le style du titre
Feasibility of automated network management and control with dynamic
delivery of Telecom network services to end users: e.g. company customers.
The first steps are focused on Connectivity services managed through a well
defined Service Management System (SRV) described.
Each connectivity service is designed with specific attributes including:
 Service Access points (UNI), throughput (x Gbps), end-to-end latency (y ms), time interval [T1,T2]
GMPLS based control protocols, Timed based PCE, Network Resource Scheduler with
Carrier Switches and Wavelength Cross-connects as connection services are based
on Ethernet Virtual Circuit over Wavelength connections:
 Provisioned: through NMS with automated network Operations through MTOSI 2.0 (triggered by SRV)
 Signaled: RSVP-TE provides dynamic E2E guaranteed QoS on two routing areas
10
Service Activation Interface : SRV-NRS

Connection Service Component Activation: EVC Services
 SRV  NRS (phase 1): Timed EVPLINE, EVPLAN, E-TREE provisioning
 TE management
 Connection
Provisioned
Monitoring
 SRV-DB
Cliquez
pour
modifier
leNRS
style
du titre


Background and periodic process (from Network States)
Downward information: SRV  NRS
 Connectivity topology is an Ethernet Service graph



Access points: location,
Bandwidth (pipes)
Latency on the links
 Commands for new connectivity services





Upward information: NRS  SRV
 Connection status:




Feasibility
Reservation
Provision
Activation
Reserved / Available
Provisioned / Unprovisioned
Activated (i.e. used) / De-activated
Shared Info/Data Model based on MTOSI 2.0 / TMF
 SCAI: Resource facing Interfaces (Connection data model)
11
References on Experimentation plans


Ethernet  MPLS-TP over WDM Network architecture referencing :
 Reconfigurable-OADM based WDM transmission: 1626LM (with 40 Gbps)
 Carrier Grade Ethernet based Transport Networks: 1850TSS
Cliquez pour modifier le style du titre
 Network Configurations based on Management: 1350-OMS service functions
Large Scale Distributed Applications (Grid Applications):
 Computing and Storage Service on Demand (Ter@tec): LUSTRE CFS Application
 Instruments: Industrial (Remote Visualization): EDF Picture Walls
North Bound Interface
Negotiation protocol
(e.g. WS-agreement based)
Connection
Services
Requests
Connectivity
Services
Scheduling
SchedulingReconfiguration
Reconfiguration
&&Virtualization
Virtualization
(SRV)
(SRV)service
service
Delivery
Network Management Systems
(1353NM – 1354BM-Ethernet)
Advertisement protocol
(e.g. WS-notification based)
South Bound Interface
Application Client
Visual. Server
Network Controller
Ethernet Switch
(Customer Equipment)
Network
Controller
Grid Application
Client / Server
Ethernet Switch
(Customer Equipment)
1850 TSS-320
(Provider Edge)
b/s
nx10 G
:
λ
on
link 2
smissi
n
a
r
t
y
t
i
c
a
p
a
High-C
EDF Clamart
(PoP 1)
A1850 TSS-320 (PE)
1626LM
CE
1626LM
1
PE
CEA-Saclay
(PoP 3)
1626LM
link 4
Application Client
Storage Server
PE
link 3
s:
ission
Transm
Gb/s
 40
s
/
b
G
0
λ: 4x1
CE
10Gb/s Interfaces
(Ethernet frame aggregation over λ)
HPC + Storage
Servers
Network
Controller
link
Network
Controller
Univ. Orsay
(PoP 2)
CEA Ter@tec
(PoP 4)
1626LM
12
CARRIOCAS Network Pilot and
test bed configuration
4 x 10GEth.
1354BM Network Management
1353NM
Picture wall
Clamart
Local monitoring
Issy les
Moulineaux
Cliquez pour modifier le
style
duSwitch
titre
Transport
Service
Carrier Grade Ethernet with T-MPLS capabilities
1850 TSS
Trib 40G prototypes
fournis
gracieusement par
Alcatel dans SP1
durant la vie du
projet
4 x 10GEth.
4 x 10GEth.
Local monitoring
storage
Saclay
Orsay
4x10 GEth. Access
storage
Légende
40 Gbps Transmission
1626 LM
Super-computers
Ter@tec
Bruyères
Le Châtel
Lambda 1 à 10G omnibus
Lambda 2 à 10G
Lambda 3 à 10G
Lambda 4 à 10G
Lambda 5 à 40G
Nx10 Gbps Transmission
4 x 10GEth.
Deployment phase 1 (10Gb/s): June 2007
Deployment phase 2 (40Gb/s): June 2008
13
Towards Network Centric Cloud Computing
 Respond to strong demands by Organizations on accessing HighPerformance IT services remotely through WAN with strict QoS:
 Grid  Cloud Computing towards Utility Computing
Cliquez pour modifier le style du titre
 Service optimized Transport Networks & Data Grid Facilities will be
built on different requirements to offer e-science services
 Depending if Public or Private owned infrastructures
 Needs to coordinate our efforts for standardizations
 SRV v1 software, developed by INRIA, automates:
•
•
•
•
Support for different network services offered by multilayer networks (Lx-VPN)
Mapping of applications/users requirements over connectivity services
Fine grain Dynamic Bandwith Requests scheduling
Connection service Reconfiguration  Optimization  X-optimization
 Standardization efforts at ETSI (Grid TC) led by BT and Alcatel-
Lucent with contributions from BT, FT, Telefónica, Nokia-Siemens,
 close follow-up at Open Grid Forum (through Phosphorus collaboration)
14
Many Thanks to
CARRIOCAS-SP2 Colleagues for their
contributions
Cliquez pour modifier le style du titre
French Ministry of Industry, Essonnes,
Haut-de-Seines and Paris General Council
for their supports on CARRIOCAS project
http://www.carriocas.org
Special thanks to PHOSPHORUS and G-Lambda
projects for their stimulating and valuable
interactions

Questions ?
15
CARRIOCAS Network Environment

Emulated Platform is based on CARRIOCAS network pilot architecture*
 Two Routing Areas (1 per switching layer): (i) CGEthernet (ii)
Wavelength
Cliquez
modifier le style du titre
 5 PoP emulated,
each PoPpour
is
 Carrier Switch (Ethernet-switching capable) + PXC (Lambda-switching capable)
OADM node
Wavelength X-Connect
CORE
ec
Wavelength connection 1
co
nn
Routing Area 0
th
* Mais contient des fonctions supplémentaires
tio
n
2
λ / GMPLS
av
el
en
g

Carrier Grade Ethernet Network services
Dynamic Ethernet LSP establishments
Routing Area 1
Virtual Topology
 5 EVPLINE services
Ingress node
Egress node
Ethernet LSP 1
 1 EVPLAN service (4 locations)
LSR1
LSR2
Ethern
Static Wavelength LSP characterized by
et LSP
2
 Capacity: 3x10Gbps, 1x30Gbps,
1x40Gbps
Intermediate edge node
UNI
 Latency: 1ms ≤ t ≤ 10 ms
W

 10 Node controllers (5+5): RSVP-TE + OSPF-TE
 2 Path Computing Engines (1 per layer): PCEP, OSPF-TE
 1 NMS: performs resource inventory at L2 and L1
16
6Network configuration implementation (1/2)

5 point-to-point Ethernet LSP (E_LSP): E_LSP(ERO,BW(Gbps),delay(ms))


1 point-to-multipoint
Ethernet
LSP: modifier
Cliquez
pour

SRV-DB
E_LSP_1 ({AB},5,1); E_LSP_2 ({ABC},10,5); E_LSP_3 ({A↔C},40,1); E_LSP_4 ({AC
D},20,10); E_LSP_5 ({A↔B↔E},15,5);
C
E_LSP_ 6({tree_1},10,10);
SRV
B
A
D
E
tree_1
LSR_D
RSVP-TE + OSPF-TE LSRs
Layer 2 Switch Capable (51)
Service
Scheduling
LSR_C
TE-link
LSR_A
MTOSI Commands (over HTTP/SOAP - AXIS)
NRS Agent
S-PCE
Network
Management System
TE-Link
DB
LSR_B
LSR_E
PMSER
algorithm
XML NetConf RPCs
PCEP Commands (RPCs)
PCC
le style du titre
S-PCE
TE-Link
DB
LSR_4
LSR_3
LSR_1
RSVP-TE + OSPF-TE LSRs
Lambda Switch Capable (150)
TE-link
LSR_2
LSR_5
17
Network configuration implementation (2/2)

5 wavelength LSPs (L_LSP): L_LSP(ERO, BW(Gbps)


L_LSP_1 ({1 ↔ 4},10); L_LSP_2 ({1 ↔(4)↔ 3},30); L_LSP_3 ({1↔(5)↔ 2},40); L_LSP_4 ({2
↔ 3},10); L_LSP_5 ({1 ↔ 5},15);
Scenarios – Connectivity
services
by SRVle
Cliquez
pourmanaged
modifier

style du titre
T0=1 (January 1st) , T1=55 (February 24th), duration=nb of slots (1 time_slot = ½ day),
e.g. duration = 60 (30 days)
End-points
T1/duration
Max. Throughput/
Guaranteed BW.
e2e delay (ms)
Service
availability
Application_id
(information)
A↔B
23/10
38.4 / 30 Gbps
5 ms
99.999%
Ultra-high
perf. Visu Coll.
AB
26/60
10 / 5
100ms
99.999%
Back-up
Storage
A↔D
24/20
20 / 10
5 ms
99.999%
Ultra-high
perf. Visu
ED
38 / 6
5/1
1 ms
99.999%
VideoStreaming
DC
35 / 12
30 / 10
10 ms
99.9 %
Data Storage
C{A,E,D}
30 / 16
15 / 10
5 ms
99.99%
Tele-Call-Conf
T0
T1-ε
T2+ε
T2 = T1 + duration
18