TNC 2011 Pau Minoves (Technical Manager) Prague, May 2011 1 Mantychore @ a Glance Mantychore legacy 2006 – Manticore 2007 – Manticore II • (also with RedIris, Cisco and Juniper) 2010 – Mantychore FP7 ICT-2010 Call 7 1.2.3 – Virtual Research Communities Total Project Cost: 1,564,386€ EC contribution: 1,399,740€ Start date: October 2010 Duration: 30 months Partners composition 1 Research Center 2 NREN 3 users 1 commercial operator Overview 2 Challenges VISION Provide a software implementation and tools for providing and managing routers and IP networks as services. Open project consideration Public documentation Open mailing list Feedback and involvement are welcomed MISSION By means of: • • • Infrastructure Provisioning: Marketplace of Physical/logical routers and IP networks IP Network as a Service: Creation and configuration of IP networks L1 and L2 integration Ether project (Ethernet and MPLS) Argia project (Optical network devices) Providing the service to 3 virtual research communities Mantychore will be deployed over the infrastructure of: • • 2 NRENS NORDUnet, HEAnet 3 initial users. UNI-C, TCD, University of ESSEX www.mantychore.eu 3 Our Challenge VISION Provide a software implementation and tools for providing and managing routers and IP networks as services. MISION By means of : Infrastructure Provisioning: • Marketplace of Physical/logical routers and IP networks IP Network as a Service: • Creation and configuration of IP networks • L1 and L2 integration Providing the service to 3 virtual research communities Mantychore will be deployed over the infrastructure of 2 NRENS and 3 initial users. Overview 4 Objectives Deploy an operational IP Network as a Service •Enable HEAnet and NORDUnet to provide IP Network Services to their users enhancing their service portfolio. •Improve research communities activities and optimize the efficiency of use of e-Infrastructures. • Refine and expand the Mantychore services provided by means of integrating, with IaaS tools, solutions for optical and Ethernet/MPLS networks. Marketplace for resource trading •Innovate in the business model, establishing a marketplace where all Infrastructure Providers can publish their available resources. Customers can automatically negotiate the SLAs getting the best resource combination for their needs. • Use Mantychore services to contribute to the research performed in the GreenStar Network (GSN) project to enable carbon-neutral infrastructures. Commercial Exploitation www.mantychore.eu Integrated Layer 1-3 services Carbon-neutral eInfrastructures • Evaluate the likehood of Mantychore services (open source based) in a commercial telco environment and elaborate a business plan focused on this service for telco operators. 5 USERS AND USE CASES www.mantychore.eu 6 User Community V M V M VM V M V M V M V V M d Site 5 Gri s d Site 3 V M V M VM M Gri s V V M VM M Gri s d Site 6 IP Network as a Service V VM M Gri s d Site 1 V M V M VM Gri s d Site 2 V M V M V V M VM M Gri s d Site 4 Grid-Ireland “Cloud Layer”, TCD Improving the Health Data Network, Dedicated IP Networks to support media services (Wales and Scotland), router Authorized User Connection Agreement System Health Data Network Hub router router router Fixed connections + VPNs + MANTICORE managed IP Networks Site 1 router Site 2 www.mantychore.eu 7 Virtual CPE – Scenario 1 Provider’s domain (HEAnet) CPE Client A domain Client B domain Providers enforce parts of the CPE configuration i.e. BGP policies. Delegation of partial configuration rights to clients. Internal IGP VRRP Firewall … Automatic provisioning of new clients. Reduce need for new hardware deployments. Physical Router Logical Router SA1 Software Refinement 8 Virtual CPE – Scenario 2 Provider’s domain (Health Data Net.) MPLS LSP’s Provider’s domain (UNI·C) CPE Client A domain Physical Router Logical Router VPN SA1 Software Refinement Providers enforce parts of the CPE configuration i.e. BGP policies. Delegation of partial configuration rights to clients. Internal IGP VRRP Firewall … Automatic provisioning of access to provider LSP channels. Directly or via a VPN. Reduce need for new hardware deployments. Reporting to existing accounting infrastructure. 9 Virtual CPE – Scenario 2 Provider’s domain (Health Data Net.) MPLS LSP’s Provider’s domain (UNI·C) CPE Client A domain Physical Router Logical Router VPN SA1 Software Refinement Providers enforce parts of the CPE configuration i.e. BGP policies. Delegation of partial configuration rights to clients. Internal IGP VRRP Firewall … Automatic provisioning of access to provider LSP channels. Directly or via a VPN. Reduce need for new hardware deployments. Reporting to existing accounting infrastructure. 10 Distributed and Private Cloud – Scenario 1 This scenario will use Grid-Ireland nodes to test complex cloud-like sharing of resources and flexible networks. A grid site is formed by: Infrastructure nodes Worker nodes Currently, only infrastructure nodes have connectivity. SA1 Software Refinement 11 Distributed and Private Cloud – Scenario 1 We foresee a two stage implementation: At a first stage: Use of a L3 VPN Policies at TCD. Low impact Will allow the. grid site to meet at a NREN-managed logical router Worked nodes, will be able to be aggregated in a flexible cloud. SA1 Software Refinement 12 Distributed and Private Cloud – Scenario 1 We foresee a two stage implementation: At a first stage: Use of a L3 VPN Will allow the. grid site to meet at a NRENmanaged logical router Worked nodes, will be able to be aggregated in a flexible cloud. SA1 Software Refinement 13 Distributed and Private Cloud – Scenario 1 We foresee a two stage implementation: At a second stage: Institutional IT departments will be involved in the setup. Implement L2 solutions where possible. Avoid tunneling overhead. SA1 Software Refinement 14 Distributed and Private Cloud – Scenario 2 Three actors involved: Virtual Machine IaaS Provider – NREN or comercial operator. Offer virtual private clouds. Configurable user addressing space. L2 access. Network IaaS Provider – NREN SUnet. Redundant Full mesh LSPs. Campus Computing resources consumer. Router partially managed by Mantychore. Main requirement: Network transparency. Avoid any reconfiguration of >L4 services. SA1 Software Refinement VM migration 15 Mantychore vs new Amazon VPC Amazon VPC launched dynamic networks on March‘11 Amazon VPC has four templates: A) VPC with public subnet. B) VPC with public and private subnet. C) VPC with Internet and VPN access. D) VPC with VPN only access. Mantychore will implement: D -> C -> A. Base technologies Support IPv6 is being studied. VPNs both at L3 and L2 (MPLS, pure-VLAN). Open Source. Inspect the source code. Adapt, customize. Deploy on your own infrastructure. Integrate with existing deployed systems. SA1 Software Refinement 16 Ultra High Definition Applications Deployment of next Physical topology generation multimedia applications Logical topology 3D, UHD Stream producers and consumers. 3D medical applications. 3D virtual tourism. USERS USERS GLASGOW ESSEX JANET UK-IP USERS USERS Flexibility to adjust, network independent of underlying infrastructure. Bandwidth on Demand. SA1 Software Refinement CARDIFF USE RS USE RS 17 THE TOOLSET www.mantychore.eu 18 Mantychore Architecture External Interface. Pluggable (so REST easily supported) Currently Web Services based. • Easy to integrate with other existing middlewares Like cloud provisioning. A comprehensive GUI for desktop and Web (WIP). SA1 Software Refinement Other Middleware or GUI Desk. Resources WS ROADM WS Router WS IP Network WS … Web Reporting System Fuse ServiceMix 19 Mantychore Architecture Integration with existing infrastructure. For access control: • Use SAML to integrate with existing identity providers. ces WS r WS Conf. Engine For reporting Protocol M WS • Integration with existing ticket/bug systems. Access Control Reporting System e ServiceMix Exiting infrastructure ork WS Integrate Mantychore with the organization’s current workflow and tools. Infrastructure operators: Mantychore offers Operators a CLI to manage mantychore services. Profiles feature allows the operator to modify or override the configuration that is sent to the network equipment • Important to enforce institutional policies. SA1 Software Refinement 20 Technologies Development Testing FUSE ESB Kernel Console Logging Provisioning Deployer Admin Spring DM Security OSGI Framework SA1 Software Refinement 21 MARKETPLACE www.mantychore.eu 22 WP6 Overall Objective Study, design and simulation of the necessary algorithms for the implementation of the MANTYCHORE marketplace mechanism Enable the automatic negotiation and reservation of resources between users and providers. • The capability to automatically select, orchestrate and reserve the best resources for a given request To use the marketplace in order to allow the NRENs to announce their own infrastructure as resources of MANTYCHORE services Users from virtual research communities will be able to access resources from several providers JRA1 Infrastructure resources marketplace 23 Technical Progress Study and analysis of existing and state of the art work Review of projects and framework relevant to L3 virtualization and virtual IP resource allocation • • • • • XBONE PLanetLab VIOLIN AUTOI AGAVE Review of existing network brokering mechanisms • Internet2 approach: NARB (Network Aware Resource Broker) • Grid approach: Market-Oriented Grid algorithms JRA1 Infrastructure resources marketplace 24 Technical Progress Definition of market place based use case The use case will be based on UK Ultra-high Definition (UHD) consortium network infrastructure • The UK Ultra-high Definition (UHD) consortium is a networked infrastructure for the development and deployment of next generation networked multimedia applications and services. It consists of five members namely: University of Essex (Essex), University of Strathclyde (Glasgow), Digital Design Studio (Glasgow), University of Cardiff (Cardiff), and Technium CAST (Bangor). • The current setup is made up of three networked nodes – Essex, Glasgow, and Cardiff – which are interconnected via the JANET UK network, and is investigating the development and deployment of interactive UHD 3D media applications in the medical and cultural heritage/ virtual tourism domains. JRA1 Infrastructure resources marketplace 25 Technical Progress Definition of market place based use case Use case emulated infrastructure Emulated Infrastrcuture2 Emulated Infrastrcuture1 JRA1 Infrastructure resources marketplace 26 GREEN IT www.mantychore.eu 27 Scope of JRA2 MANTYCHORE-GSN collaboration has the objective to design necessary experiments and tests which eventually check the viability of the movement of services (virtual machines (VMs and applications)) using flexible device configuration utilities such as Infrastructure as a Service and Bandwidth on Demand solutions. Perform the integration between GSN and MANTYCHORE (physical integration between the GSN and the NRENs infrastructure and also the services integration). EPA building rooftop, Ireland JRA2 Zero-carbon emission virtual infrastructures Dunhill, Ireland 28 GSN Objectives Initiate a consortium of industry, universities and government agencies with the common goal of reducing greenhouse gas (GHG) emissions arising from information & communication technology (ICT) services Create tools, protocols, procedures, and use cases for a growing network of ICT service providers that offers customers the lowest price and greenest services JRA2 Zero-carbon emission virtual infrastructures 29 GSN Node & Network GSN associates and MANTYCHORE GSN / Mantychore Integration team meetings active focusing on • Test Case Generation • Solution Integration requirements and benefits analysis • Training JRA2 Zero-carbon emission virtual infrastructures 30 IBBT GSN Node JRA2 Zero-carbon emission virtual infrastructures 31 Join us! ENLARGE THE USER COMMUNITY www.mantychore.eu 32 Open Project Approach Official Website Points to all the resources www.mantychore.eu Open Wiki http://jira.i2cat.net:8090/display/MANTECH/Home Open Mailing list Open technical Archives online http://listas.i2cat.net/cgi-bin/mailman/listinfo/mantychore-technical Open Source http://anon:anon@svn.i2cat.net/repos/manticore/ Open Project 33 Open Project Approach News Pointers to all past presentations Archives How to get a copy of the source code Open Project 34 Open Project Approach Pointers to all participation channels Partner only area Open Project 35 Open Project Approach Private area User Documentatio n Working Area Work Packages and Task have spaces here Deliverables are published here Public readonly Open Project 36 Join the community [WP3] www.mantychore.eu 37 Survey Available We have (short) survey available. We would love to hear your thoughts on Mantychore and if you think it would fit you. Or what it would need to fit you. Plus we have some ipad/laptop sleeves available. But do it for science, right? ;) www.mantychore.eu 38 Find us You can also take the survey online at: http://fi2.cat/tnc2011survey Or find i2CAT’s booth at: Between DANTE and RIPE NCC. www.mantychore.eu 39 Thanks for listening QUESTIONS? BACKUP SLIDES Protocol Architecture M2M network Web Service User Access Http Resource control Juniper- Netconf Cisco- WSMA (on coming) WP4- SOFTWARE REFINEMENT Mantychore Server 42 Federation Architecture Users can configure resources from external domains Create/configure Logical switches Logical routers IP networks Provisioning L1 & L2 WP4- SOFTWARE REFINEMENT 43 Complete Gantt WP4- SOFTWARE REFINEMENT 44