Welcome to GEC 3
Global Environment for Network Innovations
GENI Engineering Conference (GEC) 3
www.geni.net
Clearing house for all GENI news and documents
GEC 3 - Launch
www.geni.net
1
GENI Engineering Conferences
Meet every 4 months to review progress together
• GEC 1 (U. Minnesota), GEC 2 (NSF)
• GEC 3 – HP Labs, Palo Alto
• Meetings are open to all who fit in the room
–
–
–
–
Held at regular 4-month periods
Geographic rotation through US (central, east, west)
Held on / near university campuses – volunteers?
Travel grants for participant diversity (US academics only)
• Current plans for future GECs
–
–
–
–
GEC 4 – Florida International University, Miami, March 17-19, 2009.
GEC 5 – University of Washington, Seattle, July 21-23, 2009.
GEC 6 – University of Utah, Salt Lake City, Nov. 16-18, 2009.
GEC 7 – RENCI, Chapel Hill, March 16-18, 2010.
GEC 3 - Launch
www.geni.net
2
This Conference’s Theme
Launching GENI Spiral 1
• GENI Spiral 1 is now starting up
– 29 academic / industrial teams
– Organized into 5 competing control frameworks
– Goal is first integrated prototypes “up and staggering” in 6-12
months
– . . . from campus wiring closets through backbones
– . . . from programmable routers and compute clusters through
vehicular wireless and large-scale sensor networks
– Early demos at GEC 4 in March
• GEC 3 launches Spiral 1
– It aims to make it clear “where you fit” . . .
– . . . and what you need to do in the next 6-12 months
GEC 3 - Launch
www.geni.net
3
With many thanks to . . .
• HP Labs
–
–
–
–
Dr. Prith Banerjee, Director of HP Labs
Dr. Jack Brassil, local organizer
Dr. Rick McGeer
and many others
• National Science Foundation
– Dr. Jeannette Wing and Dr. Ty Znati
– Dr. Suzi Iacono and Ms. Gracie Narcho
• Many volunteers
– Peter O’Neil, new chair of Substrate WG
• and behind the curtains
– Larry Landweber
– Henry Yeh
GEC 3 - Launch
www.geni.net
4
And “our founders”
The GENI Planning Group and Many, Many Working Group Volunteers
Larry Peterson, Princeton (Chair)
Nick McKeown, Stanford
Tom Anderson, Washington
Dipankar Raychaudhuri, Rutgers
Dan Blumenthal, UCSB
Mike Reiter, CMU
Dean Casey, NGENET Research
Jennifer Rexford, Princeton
David Clark, MIT
Scott Shenker, Berkeley
Deborah Estrin, UCLA
Amin Vahdat, UCSD
Joe Evans, Kansas
John Wroclawski, USC/ISI
Terry Benzel, USC/ISI
CK Ong, Princeton
And Within NSF
Peter Freeman
Guru Parulkar
Ty Znati
Debbie Crawford
Darleen Fisher
Gracie Narcho
Larry Landweber
Cheryl Albus
Paul Morton
Suzi Iacono
Allison Mankin
Their hard work has created GENI’s Conceptual Design,
the starting point for all our work going forward.
GEC 3 - Launch
www.geni.net
5
In memory of Jay Lepreau
GEC 3 - Launch
www.geni.net
6
Conference plan
Tuesday
Wednesday
GENI Spiral 1 – Intro
and Control Frameworks
Control Framework WG
Lunch (12:35 – 2 PM)
Lunch / posters (12:00 – 2 PM)
End-to-End Slices –
Intro and
Selected Project Talks
Opt-in
WG
Substrate
WG
Experiment
Workflow
WG
OMIS
WG
Lunch* (12:30 – 2 PM)
Asia Report
EU Report
OpenFlow Demo
NetSE + Opt-in Reports
Feedback to GPO
Networking Session
Internet2, NLR, Quilt
GPO Solicitation #2
* International BOF lunch will
meet in Bldg 20 Akita
Control Framework
breakout meetings
GEC 3 - Launch
Thursday
CCC Update
www.geni.net
7
Conference materials
•
•
•
•
Agenda
GENI Spiral 1 Overview
Poster board assignment
GENI Engineering Conference survey
• T-shirt and pen, courtesy of HP Labs and EDJ
• Links to draft engineering documents
– System Requirements
– System Overview
– Control Framework Architecture
GEC 3 - Launch
www.geni.net
8
Some key introductions
• Network Science and Engineering Council (NetSE)
– Prof. Ellen Zegura, Chair
• GENI Working Group Chairs
– Prof. Jeff Chase, Prof. Patrick Crowley, Prof. Joe Evans, Mr.
Peter O’Neil, Prof. Larry Peterson, Ms. Heidi Picher Dempsey,
Dr. Kristin Rauschenbach, Prof. Henning Schulzrinne, Mr. John
Wroclawski
• National Science Foundation – CISE
– Dr. Ty Znati, Dr. Suzi Iacono, Ms. Gracie Narcho
• GENI Project Office (GPO) staff
GEC 3 - Launch
www.geni.net
9
The NetSE Council
Ellen Zegura (Chair)
Tom Anderson (UW)
Joe Berthold (Ciena) Charlie Catlett (Argonne)
Joan Feigenbarum (Yale) Stephanie Forrest (UNM)
Mike Dahlin (UT Austin)
Jim Hendler (RPI) Michael Kearns (U.Penn) Ed Lazowska (UW)
Chip Elliott (GPO)
Peter Lee (CMU)
And not shown . . .
Roscoe Giles
Helen Nissenbaum
GEC 3 - Launch
Larry Peterson (Princeton)
www.geni.net
Jennifer Rexford (Princeton)
10
Alfred Spector (Google)
Introductory words from
NSF CISE and HP Labs
• Dr. Suzanne Iacono
GENI Program Director, NSF CISE
• Dr. Jack Brassil, HP Labs
GEC 3 - Launch
www.geni.net
11
Launching
GENI Spiral 1
Global Environment for Network Innovations
GENI Engineering Conference (GEC) 3
www.geni.net
Clearing house for all GENI news and documents
GEC 3 - Launch
www.geni.net
12
The GENI Vision
A national-scale suite of infrastructure for long-running,
realistic experiments in Network Science and Engineering
Virtualized
Deeply programmable
Programmable & federated, with end-to-end virtualized “slices”
Sensor Network
Federated
International
Infrastructure
GEC 3 - Launch
Mobile Wireless Network
www.geni.net
Heterogeneous,
and evolving over time via
spiral development
13
Edge Site
Spiral Development
GENI grows through a well-structured, adaptive process
• An achievable Spiral 1
Planning
Design
Rev 1 control frameworks, federation of
multiple substrates (clusters, wireless,
regional / national optical net with early
GENI ‘routers’, some existing testbeds),
Rev 1 user interface and instrumentation.
• Envisioned ultimate goal
Use
Use
Example: Planning Group’s desired GENI
suite, probably trimmed some ways and
expanded others. Incorporates large-scale
distributed computing resources, high-speed
backbone nodes, nationwide optical
networks, wireless & sensor nets, etc.
• Spiral Development Process
Integration
Build out
Re-evaluate goals and technologies yearly
by a systematic process, decide what to
prototype and build next.
GENI Prototyping Plan
GEC 3 - Launch
www.geni.net
14
Federation
GENI grows by “gluing together” heterogeneous infrastructure
My experiment runs across
the evolving GENI federation.
Wireless
#1
Corporate
GENI suites
Backbone #1
Compute
Cluster
#1
Compute
Cluster
#2
My GENI Slice
Access
#1
Backbone #2
NSF parts of GENI
Other-Nation
Projects
Other-Nation
Projects
This approach looks
remarkably familiar . . .
Wireless
#2
Goals: avoid technology “lock in,” add new technologies as they mature, and potentially
grow quickly by incorporating existing infrastructure into the overall “GENI ecosystem”
GEC 3 - Launch
www.geni.net
15
GENI System Decomposition (simplified)
Engineering analysis drives Spiral 1 integration
GENI Admin and Ops Org
GENI Clearinghouse
<
Register
<
Admin and Account
Trust
<
Slice
Create
Principal
Registry
<
Register
Slice
Registry
EU Clearinghouse
(federated
network
example)
(Aggr)
Comp
Registry
EU
Admin
and
Ops
Org
< Admin
=<
Ticket
Broker
<
Authen
< Operator
<
Ops and Mgmt
Ticket
Log
=<
View
Help
Desk
=<
View
=<
View
Trust
Research
Org A
< Slice
Admin
=
Researcher
Helper
Tools
= PI
GENI Programmable
Host Cluster A
GENI Programmable Ntwk
Routing (Switch) Node B
GENI Metro (Sensor)
Wireless Ntwk C
GENI Enterprise (Resident)
Access Ntwk D
GENI Regional (National)
Optical Ntwk E
< Com
Admin
< Com
Admin
< Com
Admin
< Com
Admin
< Com
Admin
Comp
Operator
Comp
Operator
Comp
Operator
=<
Component Mgr
=<
Component Mgr
=<
Component Mgr
=<
Component Mgr
<
Ops Portal
<
Ops Portal
<
Ops Portal
<
Ops Portal
<
Ops Portal
Host
Ax
Node B
Ntwk C
Ntwk D
Ntwk E
PoP
Research
Org B
Comp
Operator
=<
Component Mgr
Host
A1
= Research
Comp
Operator
EU
Comp
AA
PoP
Experiment Plane
Measurement Plane
= Control Plane
< Ops and Mgmt Plane
GEC 3 - Launch
www.geni.net
16
Resource discovery
Aggregates publish resources, schedules, etc., via clearinghouses
What resources can I use?
GENI
Clearinghouse
These
Researcher
GEC 3 - Launch
Components
Components
Components
Aggregate A
Aggregate B
Aggregate C
Computer Cluster
Backbone Net
Metro Wireless
www.geni.net
17
Slice creation
Clearinghouse checks credentials & enforces policy
Aggregates allocate resources & create topologies
Create my slice
GENI
Clearinghouse
GEC 3 - Launch
Components
Components
Components
Aggregate A
Aggregate B
Aggregate C
Computer Cluster
Backbone Net
Metro Wireless
www.geni.net
18
Experimentation
Researcher loads software, debugs, collects measurements
Experiment – Install my software,
debug, collect data, retry, etc.
GENI
Clearinghouse
GEC 3 - Launch
Components
Components
Components
Aggregate A
Aggregate B
Aggregate C
Computer Cluster
Backbone Net
Metro Wireless
www.geni.net
19
Slice growth & revision
Allows successful, long-running experiments to grow larger
Make my slice bigger !
GENI
Clearinghouse
GEC 3 - Launch
Components
Components
Components
Aggregate A
Aggregate B
Aggregate C
Computer Cluster
Backbone Net
Metro Wireless
www.geni.net
20
Federation of Clearinghouses
Growth path to international, semi-private, and commercial GENIs
Make my slice even bigger !
GENI
Clearinghouse
Federated
Clearinghouse
Components
Components
Components
Components
Aggregate A
Aggregate B
Aggregate C
Aggregate D
Computer Cluster
Backbone Net
Metro Wireless
Non-NSF Resources
GEC 3 - Launch
www.geni.net
21
Operations & Management
Always present in background for usual reasons
Will need an ‘emergency shutdown’ mechanism
Stop the experiment
immediately !
GENI
Clearinghouse
Oops
Federated
Clearinghouse
Components
Components
Components
Components
Aggregate A
Aggregate B
Aggregate C
Aggregate D
Computer Cluster
Backbone Net
Metro Wireless
Non-NSF Resources
GEC 3 - Launch
www.geni.net
22
GENI Spiral 1 has now begun!
First results expected in 6-12 months
GENI Project Office Announces $12M for
Community-Based GENI Prototype Development
July 22, 2008
The GENI Project Office, operated by BBN Technologies, an advanced
technologies solutions firm, announced today that it has been awarded
a three year grant worth approximately $4M a year from the US
National Science Foundation to perform GENI design and riskreduction prototyping.
The funds will be used to contract with 29 university-industrial teams
selected through an open, peer-reviewed process. The first year
funding will be used to construct GENI Spiral 1, a set of early,
functional prototypes of key elements of the GENI system.
GEC 3 - Launch
www.geni.net
23
Generous Donations to GENI Prototyping
Internet2 and National Lambda Rail
Internet2
10 Gbps dedicated bandwidth
National Lambda Rail
Up to 30 Gbps nondedicated bandwidth
40 Gbps capacity for GENI prototyping on two national footprints
to provide Layer 2 Ethernet VLANs as slices (IP or non-IP)
GEC 3 - Launch
www.geni.net
24
GENI’s Critical Technical Risks
These risks drive the Prototyping Goals for GENI Spiral 1
Create my slice
Critical Risk #1
Clearinghouse & control framework
is central but never demonstrated
GENI
Clearinghouse
Critical Risk #2
End-to-end slices across multiple
technologies have never been demonstrated
GEC 3 - Launch
Components
Components
Components
Aggregate A
Aggregate B
Aggregate C
Computer Cluster
Backbone Net
Metro Wireless
www.geni.net
25
Key Goals for GENI Spiral 1
Drive down the critical technical risks in GENI’s concept
Create my slice
GENI
Goal #1
Clearinghouse
Fund multiple, competing teams to
develop GENI Clearinghouse
technology, encourage strong
competition within the first few spirals
Goal #2
Demonstrate end-to-end slices across
representative samples of the major
substrates / technologies envisioned in GENI
Components
Components
Components
GEC 3 - Launch
Aggregate A
Aggregate B
Aggregate C
Computer Cluster
Backbone Net
Metro Wireless
www.geni.net
26
Spiral 1 integration and trial operations
Five competing control frameworks, wide variety of substrates
Reference
Design
Cluster A
Cluster B
Components
Components
Components
Aggregate A
Aggregate B
Aggregate C
Computer
Cluster
Backbone Net
Metro Wireless
Components
Components
Components
Aggregate
A1
Aggregate
A2
Aggregate
A3
Computer
Cluster
Optical Network
Metro Wireless
Components
Cluster C
Components
Components
Cluster D
Components
Components
Aggregate
C1
Aggregate
C2
Aggregate
D1
Aggregate
D2
Computer
Cluster
Programmable
Switches
Optical Network
Sensor Network
GEC 3 - Launch
Cluster E
Components
Components
Components
Aggregate
B1
Aggregate
B2
Optical Network
Sensor Network
Components
Components
Aggregate
E1
Aggregate
E2
Aggregate
E3
Aggregate
E4
Computer
Cluster
Optical Network
Sensor Network
Programmable
Switches
www.geni.net
27
What do you need to do?
Key goals for Spiral 1 teams
• Integrate “vertically”
into your control framework
Reference
Design
• Integrate “horizontally”
to create end-to-end slices
Components
Components
Components
Aggregate A
Aggregate B
Aggregate C
Computer
Cluster
Backbone Net
Metro Wireless
• Demonstrate (early) integrated prototypes
in 6-12 months
• . . . and design GENI as you go!
GEC 3 - Launch
www.geni.net
28
“Large project” challenges
• Engineering teams must work together
– Each must rely on others
– If one group changes its plans without agreement, other groups are
liable to get annoyed
• Meeting your schedules and deliverables is important
– Very hard to integrate if schedules are hazy
– Or if teams deliver something different from what they promised
• We expect some attrition of teams that fail to progress . . .
– Their options will not be exercised for Years 2 or 3
– The resultant $$$ will be given to teams that perform well
– (But no DARPA-style “sudden death” downselects)
Can we really do it?
Yes! This is roughly how our community built the early Internet.
GEC 3 - Launch
www.geni.net
29
Suggestions for “how to”
•
How do I know what to do?
–
–
–
–
–
•
How do I successfully integrate my prototype and manage dependencies?
–
–
–
–
–
•
Discuss within your control framework
Ask questions within the working groups
Ask GPO system engineers
Write simple, clear documents to help others
Communicate early and often
Determine exactly who you need to integrate with
Communicate early and often within your framework
Pick simple, realistic goals with clear deadlines, and meet them
Ask GPO system engineers to help with documents and planning
Integrate early and often
What if my cluster is not working out?
–
–
–
–
Don’t wait until the last second!
Talk with your GPO system engineer
We will be sympathetic and do our best to help
But all prototypes have to be in some cluster!
GEC 3 - Launch
www.geni.net
30
Currently in the works
Regional Networks and RF Spectrum
• Regional networks
Speaker at 5 PM: Jen Leasure, Program Manager
– Key GENI participants
– Potential for very interesting
new topologies
– Perhaps GENI colo sites
– Perhaps good networks for
advanced optical networking
experiments
• National RF Research
Spectrum
– Try for good experimental
spectrum from FCC
– Suitable for wideband
cognitive radios
– Talk to Dave Farber, Srini
Seshan (CMU), Doug Sicker
(CU)
GEC 3 - Launch
www.geni.net
31
Currently in the works
Prototyping GENI through campuses
• August Meeting at O’Hare
– Thanks to EduCause (Mark Luker, Garret Sern)
– Stimulated by Larry Landweber
• CIOs from 11 major research universities
– Berkeley, Clemson, GA Tech, Indiana, MIT, Penn State, Rice, U. Alaska,
UIUC, UT Austin, U. Wisconsin
• Discussions of representative GENI prototypes
– Nick McKeown, Stanford (OpenFlow)
– Arvind Krishnamurthy, UW (Million Node GENI)
– GPO Staff
• Near-term GENI / CIO activities
– How to “GENI-enable” campus IT infrastructure
– Coordinated policy for handling side-effects of network research
(Larry Peterson, Helen Nissenbaum)
GEC 3 - Launch
www.geni.net
32
A look ahead . . .
GENI Workshops currently being contemplated
• Instrumentation and Measurement
– Prof. Paul Barford, Wisconsin
– Prof. Jim Griffioen, UKY
• Security
– Prof. Matt Bishop, UC Davis
GEC 3 - Launch
www.geni.net
33
A look ahead . . .
GENI Solicitation 2
•
Current plans (tentative)
•
– Solicitation issues ~ December 2008
– Proposals due ~ February 2009
– Total funds ~ $3.5 M / yr for 3 years,
as always subject to availability of
funds
– Existing / new GENI participants
both welcome
•
Strong preference given to . . .
– Joint Academic / Industrial teams
– Active participation of campus /
regional infrastructure providers
(e.g., letter from campus CIO)
GEC 3 - Launch
Current thoughts on what will be
solicited
– Security design and analysis for GENI
– Experimental workflow prototypes
– Instrumentation and measurement
prototypes
– Early tries at international federation
– Other good ideas
•
Discussion on Thursday afternoon
www.geni.net
34
Some thoughts as we begin . . .
• Move fast
– A new world is unfolding very quickly
• Think big
– We have enormous opportunities
• Work together
– GENI prototyping is very much a positive-sum game
• Be yourself
– We value your creativity and insights
GEC 3 - Launch
www.geni.net
35
GENI Spiral 1
• Provides the very first, national-scale prototype of an interoperable
infrastructure suite for Network Science and Engineering experiments
• Creates an end-to-end GENI prototype in 6-12 months with broad
academic and industrial participation, while encouraging strong
competition in the design and implementation of GENI’s control
framework and clearinghouse
• Includes multiple national backbones and regional optical networks,
campuses, compute and storage clusters, metropolitan wireless and
sensor networks, instrumentation and measurement, and user opt-in
• Because the GENI control framework software presents very high
technical and programmatic risk, the GPO has funded multiple,
competing teams to integrate and demonstrate competing versions of
the control software in Spiral 1
Nothing like GENI has ever existed; the integrated, end-to-end, virtualized,
and sliceable infrastructure suite created in Spiral 1 will be entirely novel.
GEC 3 - Launch
www.geni.net
36