OPTICAL NETWORKS SUPPORTING IT SERVICES Dimitra Simeonidou, Reza Nejabati, George Zervas Work is carried out within IST project PHOSPHORUS and the ePhoton/ONe+ Network of Excellence PHOTONIC NETWORKS LABORATORY Electronic Systems Engineering Dept University of Essex, UK Colchester CO4 5UT OFC 2007 IT and Communications Convergence Information Technology Network Centric Computing and Storage Communications Commoditisation of Resources From individual computers to Internet and WWW From specialist supercomputers to clusters From individual servers to virtualized, dynamically provisioned server farms From applications to services From ownership to computing on demand and Grids ALSO BW is becoming a commodity Global distributed computing and storage facility Distributed but connected resources Linked supercomputers Distributed data management Storage-on-demand Utility computing Collaboration Grids OFC 2007 Motivation Scale up computing and/or data sets Reduce costs via capex/opex efficiencies Reduce time-to-results Reduce time to market for new services Increase reliability, availability Enable collaborations Support a market in software services OFC 2007 Bridging Network and IT+ Recourses The network as a 1st-class Grid-managed resource akin to CPU and Data Switch Optical Path Bandwidth Courtesy GGF-GHPN draft-ggf-ghpn-netserv-2 (May 2005) OFC 2007 Some Network Requirements Coordinating on-demand, secure access to distributed and heterogeneous resources (cpu, storage, bandwidth …) High performance Transmission quality and/or low latency Virtualization abstracted network resources Finesse fine granularity of control (e.g., app hints service allocation) Advance reservation of service Resource bundling network AND {cpu| data | etc.} Determinism can predict completion Security Multicast, Anycast OFC 2007 The PHOSPHORUS Project: Grid Network Service for the Scientific Users European and Global alliance of partners to develop advanced solution of application-level middleware and underlying management and control plane technologies Project Vision and Mission The project will address some of the key technical challenges in enabling ondemand end-to-end network and IT services across multiple heterogenous domains In Phase I of Phosphorus implementation the underlying network will be treated as first class Grid resource In Phase II, the IT/Grid resource will be treated as first class network resource Phosphorus will demonstrate solutions and functionalities across a test-bed involving European NRENs, GÈANT2, Cross Border Dark Fibre and GLIF OFC 2007 PHOSPHORUS Network Scenario Application 1 Application 2 Application n Applications Service plane n Service plane 1 Service plane 2 NREN+vendor 1 NREN+vendor 2 NREN+vendor n Control plane NRPS NRPS+Control plane Equipment Equipment transport+Data transport+Data Equipment transport+data OFC 2007 Multi-domain Test-bed OFC 2007 PHOSPHORUS Architecture The different domains of the Phosphorus' test-bed will have: Grid middleware UNICORE as a reference point AAA policies Three types of NRPS: UCLP DRAC ARGON Two “flavours” of GMPLS standard (Ph. 1) Grid-enabled (Ph. 2) OFC 2007 PHOSPHORUS Architecture Phase 1 Grid MW Network Service Plane NRPS Driver NRPS Driver NRPS Driver ARGON DRAC UCLP GMPLS TN GMPLS Task 1.1 Heterogeneous NRPSs interoperability Task 1.2 Interoperability of NRPS and GMPLS control plane Task 1.3 Integration of the Network Service Plane Task 1.4 Interoperability between NRPS, GMPLS and the Service Layer OFC 2007 PHOSPHORUS Architecture Phase 2 GOUNI (D) API GOUNI (S) GOUNI (S) GA-API DATA Grid Resource Info. System Optical resource GOUNI (D) GR-API Grid Resource Schedulers Physical layer adaptation Grid Resource Optical resource Constraint Based Routing DATA API Data Intensive Application API User ON-enabled Grid Middleware Optical resource Physical layer adaptation Extended GMPLS (Grid-enabled) OXC 1 OXC 2 OFC 2007 What About the Smaller User? Need infrastructures that makes storage and computational resources potentially available to a very large number of users. Distributed virtual laboratories Digital libraries and data repositories Remote medicine Consumer services Requirements Capable of processing a very large amount of small jobs from a very large number of users and processes Capable of managing large amounts of very heterogeneous media assets Cost efficient Compatible with professional grid services OFC 2007 Programmable OBS Networking: Focus is to : To migrate service layer functionality into the optical layer Enable service the network to directly offer resources (network and data) as Network elements are able to recognise and process application demands/request To offer resources as a service To facilitate intelligent discovery of distributed resources across the network To cope with random changes user patterns, demands for resources (BW/storage/processing) as well as availability of resources OFC 2007 Grid OBS Network Infrastructure Small Grid User Computational & storage resources Internet User Traditional OBS User Computational & storage resources OBS Edge Router Computational & storage resources OBS Core Router Active OBS Router Scientific User OFC 2007 Demonstration of a Fully Functional Application Aware OBS Testbed Core Node Edge Node Resource Discovery IP P A R S E R OBS C o S IP-Traffic Generator Scheduling Aggregation S I G N A L I N G OBS @ 2.5Gbps OBES Control Channel @ 2.5Gbps Data Channels S I G N A L I N G Resource Management Scheduling OBS Routing Edge Node S I G N A L I N G OBES Control Channel @ 2.5Gbps Data Channels S I G N A L I N G Resource Discovery IP OBS Scheduling Segregation OBS @ 2.5Gbps C o S IP-Traffic Generator OWC2. A Fully Functional Application-Aware Optical Burst Switched Network Test-Bed, Wed 8-10 am, session: OP/OBS OFC 2007 P A R S E R Edge Router 1 Output Edge Router Rx : Req IP 13.6 dB λ4 OBES Control Plane a) λ5 ?5 Job Core Router Rx : Req OBES Job Edge Router 1 λ6 ?6 λ7 ?7 Edge Router Rx : Job Req OBES Ack 400 us/div 200 ns OXS Output Port 1 Edge Router Tx: of Job Sub Switch Control 12.8 dB BCH Data Port 1 Plane Core Router: Switch Configuration OXS Output Port 2 Switch Control Core Router Rx: Burst of Job Sub 200ns + 200ns 400 + Time t (varies) 400ns +Time t + 200ns 400ns +Time t + 200ns + 10 µs Data Plane OFC 2007 A Scalable Service Plane for Consumer Grids Use SIP in the “middleware” SIP protocol is used in consumer services Session oriented Grid service platform Extend GRID services to the consumer base Incorporating Grid attributes to SIP Users Resources Web Service Resource Framework (WSRF) Application requiring job management? Create a SIP session Use SIP messages to Job Submission Description Language (JSDL) Submit job description Acknowledge resources availability Open/close connections GRID features Resource discovery and reservation In Collaboration with University of Bologna: Franco Callegati & Aldo Campi OFC 2007 What Have we Done? Overlay SIP Simple solution Grid functionality at the OBS network periphery only Proxy SIP-G manage the GRID messages in the edge nodes Users Resources Transport network Optical Burst Switching, 2.5 Gbit/s In Collaboration with University of Bologna: Franco Callegati & Aldo Campi OFC 2007 Test-Bed SIP Control Channel Grid-aware SIP Proxy Grid-aware SIP Proxy SIP-OBS Middleware SIP-OBS Middleware Core Node Edge Node 1 Resource Discovery IP P A R S E R OBS C o S IP-Traffic Generator Scheduling Aggregation S I G N A L I N G OBES Control Channel @ 2.5Gbps Data Channels S I G N A L I N G Resource Management Scheduling OBS Routing Edge Node 2 S I G N A L I N G OBES Control Channel @ 2.5Gbps Data Channels OBS @ 2.5Gbps S I G N A L I N G Resource Discovery IP OBS Scheduling Segregation OBS @ 2.5Gbps C o S P A R S E R IP-Traffic Generator •Overlay network architecture utilizing SIP over OBS. •It incorporates two OBS Edge Routers equipped with Grid-aware SIP Proxies on top and one Core Router •The Test-bed operates in full-duplex mode. In Collaboration with University of Bologna: Franco Callegati & Aldo Campi OFC 2007 Call flow (1/2) JSDL document encapsulated into a SIP message The message is sent to the SIP server in the edge router The server Reads the JDSL and process the job submission Provides the discovery of the resource according to the JSDL Ad hoc module developed In the experiment a database of resources location is already available at the proxy Forwards the request to the proxy in the edge router connected to the resources The session is established The proxy server communicate with the GMPLS layer and notify the session establishment to the OBS network The data of the job are collected to the optical network encapsulated into burst In Collaboration with University of Bologna: Franco Callegati & Aldo Campi OFC 2007 Call flow (2/2) Grid-aware SIP Proxy Edge router 1 User Core router Grid-aware SIP Proxy Edge router 2 Resource SIP messages over Ethernet INVITE • • 200 OK ACK OBS messages (Optical network) TE1 • Data BCH TC1 TO1 • BCH Burst data (actual job) Data TE2 BCH TC2 Data INVITE message with JSDL incapsulated, T_SIP_1 = 0,016s Acknowledgment (ACK) message T_SIP_2=0,041s • • Data TO2 BCH Burst data (job result) BYE T edge 1.1: user acknowledgment, job submission, aggregation and trasmission over OBS (Time is veriable and depends on incomming traffic and burst size) T care 1 & 2: BHC processing and reinsertion, 200ns T edge 2.2 : processing of incomming actual job and result trasmission over OBS (Time depends on processing time) Ofset 1 & 2 : Required to implement JIT transport protocol, BCP processing time at core switch and setup time of optical corosspoint switch (OXC) SIP messages over Ethernet • End session 200 OK In Collaboration with University of Bologna: Franco Callegati & Aldo Campi OFC 2007 OBS Testbed Active-OBS Router Tunable Laser Core Router Control FPGA Optical Cross-Point Switch Edge OBS Router 1 Edge OBS Router 2 Edge OBS Router Test-bed Complete application-aware OBS Testbed OXS control OBS core control Computational & Network Resource Manager Optical CrossPoint Switch (OXS) Core Active-OBS Router Setup OFC 2007 ECOC WORKSHOP: Networks for IT: A New Opportunity for Optical Network Technologies Berlin, Sunday, September 16, 14:00- 18:00 Organised by ePhoton/ONe+ and PHOSPHORUS OFC 2007