Testbeds as a Service:
GENI
Heidi Picher Dempsey
Internet2 Annual Meeting
April 8, 2014
www.geni.net
Sponsored by the National Science Foundation
April 8, 2014,
1
GENI provides a virtual lab for networking and
distributed systems research and education
•
•
•
•
•
•
•
GENI started with exploratory, rapid prototyping 5 years ago
GENI design assumes federation of autonomously owned and operated systems
Yearly prototyping cycle for an idea: develop, integrate and operate
Experimenters use the testbed while we are building it out
Even prototypes have “activist” users, and must evolve to satisfy those users or fade
away. Two of five original design frameworks predominate now.
“Horizontal” dataplane slicing as a service (or sometimes just engineered)
“Vertical” control plane APIs to negotiate and allocate resources
Funds
in hand
Needs
funding
Sponsored by the National Science Foundation
April 8, 2014,
2
GENI: Infrastructure for Experimentation
GENI provides compute, network, and wireless resources that can be
connected in experimenter-specified Layer 2 topologies.
Sponsored by the National Science Foundation
April 8, 2014,
3
GENI: Infrastructure for Experimentation
GENI provides compute resources that can be connected in
experimenter specified Layer 2 topologies.
Sponsored by the National Science Foundation
April 8, 2014,
4
Multiple GENI Experiments run Concurrently
Resources can
be shared
between slices
Experiments live in isolated “slices”
Sponsored by the National Science Foundation
April 8, 2014,
5
GENI is “Deeply Programmable”
I install software I want
throughout my network slice (into
routers, switches, …) or control
switches using OpenFlow
Experimenters can set up custom topologies, protocols and
switching of flows
Sponsored by the National Science Foundation
April 8, 2014,
6
United States GENI Resources
U
UN
N II V
VE
ER
RS
S II T
TY
Y
ISP
Internet
Metro
Research
Backbones
g
GENI-enabled
hardware
Legend
Layer 2
Data Plane
Layer 3
Control Plane
g
UN I VE RSI T Y
Regional Networks
Campus
g
• Flexible network / cloud research • VMs, bare metal nodes, SDN
infrastructure
switches (OpenFlow 1.0), software
routing or OVS OpenFlow,
• Over 1800 users (March, 2014)
WiMAX/LTE base stations and
• 52 racks installed/in progress
clients all available to
• Sponsored
10 WiMAX
(50
LTE
planned)
by the National Science Foundation
April 8,experimenters.
2014,
7
International Federation Activities
• International Federation API for
clearinghouse functions.
• Supported for multiple
clearinghouses.
• Joint GENI/FIRE (US/EU)
capability demonstrated this
year (not operating yet)
• GENI dataplane slices extend to
other research networks by special
arrangement now (Japan, Korea,
Australia)
• Shared monitoring prototype
planned for 2014
• Investigating/prototyping standards
for experimenter-driven dataplane
resource negotiation and
provisioning
• NSI, OSCARS
• GENI Stitching
• SDN Exchanges
Sponsored by the National Science Foundation
April 8, 2014,
8
Campus Requirements for
Shared Services
•
•
•
•
•
•
Sites provide space, power, security (as with other campus IT resources)
Provide at least 1Gbps OpenFlow/SDN path from rack to campus boundary *
Provide connection from rack to on-campus resources (varies by campus, usually SDN)*
Operate with up-to-date GENI-specified software (e.g. AM API, OpenStack)
Provide no-cost access to rack resources for GENI authorized users at other campuses
Provide points of contact for GENI response team (see
http://groups.geni.net/geni/attachment/wiki/ComprehensiveSecurityPgm/Aggregate
Provider Agreement v3.pdf )
* No STP or MAC learning
*
Sponsored by the National Science Foundation
April 8, 2014,
9
Process Requirements for Shared Services
•
•
•
Standard installation
processeshttp://groups.geni.net/geni/wiki/GENIRacksHome/RacksChecklistStatus
System Acceptance Testing
• Production: InstaGENI, ExoGENI
• Provisional: Dell (OpenGENI), Cisco
Shared site resource and access details
http://groups.geni.net/geni/wiki/GeniAggregate
Sponsored by the National Science Foundation
April 8, 2014,
10
Process Requirements (cont.)
•
Site confirmation tests with logs and RSPECs
http://groups.geni.net/geni/wiki/GENIRacksHome/InstageniRacks/Confirmatio
nTestStatus
http://groups.geni.net/geni/wiki/GENIRacksHome/ExogeniRacks/Confirmation
TestStatus
• Emergency Stop and Legal, Law Enforcement and Regulatory Event
Coordination (GMOC at Indiana University)
• Shared monitoring infrastructure and shared operations (6 major ops groups)
Sponsored by the National Science Foundation
April 8, 2014,
11
University of Kentucky Ops Monitoring
Dashboard of Collector
Sponsored by the National Science Foundation
April 8, 2014,
12
Network Engineering Requirements
for Shared Services
•
L2 dataplane engineering
– campuses, regional, core and
international networks
– many vendors and technologies
– 1-100GBE interfaces (GENI shares
with other R&E projects)
– Shared or exclusive experimenter
VLANs on interfaces depending on
experiment (mostly exclusive)
SDN (OpenFlow 1.0) switches with
experimenter’s and sometimes R&E
network’s controllers (many vendors,
varying implementation of standards)
Standard Internet control plane
Internet2 AL2S cross-connects and ION
http://groups.geni.net/geni/wiki/GENIOE
SSTopologiesPerformance IONtoAL2SPerformance
  

•
•
•
Sponsored by the National Science Foundation
April 8, 2014,

13
Network Engineering (continued)
• GENI dynamic
stitching available at
12 racks via Internet2
ION
http://groups.geni.net/geni/wiki/Ge
niNetworkStitchingSites
• Over 16,000 stitched
slivers since
November, 2013
• OESS GENI Stitching
Aggregate coming
soon
• Stitching operations
monitoring prototyping
with MAX, Internet2
Sponsored by the National Science Foundation
April 8, 2014,
14
Software: Clearinghouse and Aggregates
Create & Register Slice
Slice credentials
users
projects
slice
s
clearinghouse
Aggregate Manager API
Researcher
•
- listResources
- createSliver
…
Aggregate
Manager
Aggregate Resources
Clearinghouse: manages users, projects and slices
–
–
•
Tool
Standard credentials shared via custom API or new Common CH API
GENI supported accounts: GENI Portal/CH, PlanetLab CH, ProtoGENI CH
Aggregate: provides resources to GENI experimenters
–
–
–
–
–
Typically owned and managed by an organization
Speaks the GENI Aggregate Manager API (AM API)
http://groups.geni.net/geni/wiki/GAPI_AM_API_V3 most recent version
http://trac.gpolab.bbn.com/gcf download reference implementation (gcf), OMNI command line
client
Examples: PlanetLab, Emulab, GENI racks on various campuses
Sponsored by the National Science Foundation
April 8, 2014,
15
GENI Slivers
• Sliver: One or more resources provided by an
aggregate
– e.g. Bare machines, virtual machines, VLANs
Campus
#3
My slice contains slivers from
many aggregates.
Commercial
Clouds
Backbone #1
Campus
My GENI Slice
Access
#1
Research
Testbed
Corporate
GENI suites
Backbone #2
Other-Nation
Projects
Campus
#2
Sponsored by the National Science Foundation
April 8, 2014,
16
Software: RSpecs
• RSpecs: Lingua franca for describing and requesting
resources
– “Machine language” for negotiating resources between experiment
and aggregate
– Experimenter tools eliminate the need for most experimenters to
write or read Rspec
<?xml version="1.0" encoding="UTF-8"?>
<rspec xmlns="http://www.protogeni.net/resources/rspec/2"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://www.protogeni.net/resources/rspec/2
http://www.protogeni.net/resources/rspec/2/request.xsd"
type="request" >
<node client_id="my-node"
exclusive="true">
<sliver_type name="raw-pc" />
</node>
RSpec for requesting a single node
</rspec>
Sponsored by the National Science Foundation
April 8, 2014,
17
Reserving Resources using RSpecs and the AM API
•
•
•
•
Experimenter tools and aggregates talk to each other using resource
specifications (RSpecs) and the GENI Aggregate Manager API (GENI AM
API)
Advertisement RSpec: What does an aggregate have?
Request RSpec: What does the experimenter want?
Manifest RSpec: What does the experimenter have?
What do
you
have?
Experimenter
Tool
I would
like …
ListResources(…)
Advertisement RSpec
CreateSliver(Request RSpec, …)
What do I
have?
You have
Aggregate
… Manager
Manifest RSpec
ListResources(SliceName, …)
Manifest RSpec
Sponsored by the National Science Foundation
I have …
April 8, 2014,
You have
…
18
GENI Design Activities
• Open to all
http://groups.geni.net/geni/wiki/GeniDesign
• Mailing lists http://lists.geni.net/mailman/listinfo
• geni-annouce@geni.net most general
• Regular calls and design reviews announced
through interest group mailing lists
• IRC/chat (mostly
operations)http://groups.geni.net/geni/wiki/HowTo/ConnectToGE
NIChatRoom
• GENI Engineering Conferences (3 per year)
• June 21-24, 2014 University of California, Davis
Sponsored by the National Science Foundation
April 8, 2014,
19