ORCA-BEN, ORCA-AUG
Spiral 2 Year-end Project Review
Project Graphic and/or
Photo
RENCI UNC-CH, Duke University
PI: Ilia Baldine, Jeff Chase
Staff: Yufeng Xin, Anirban Mandal, Chris Heermann, Aydan Yumerefendi
Students: Prateek Jaipuria, Varun Marupadi (former)
Visiting Scholar: Namgon Kim (GIST, Korea)
08/26/10
Sponsored by the National Science Foundation
Project Summary
• Advanced control framework project, not a public testbed
• Open substrate with plugin interfaces
–
–
–
–
–
Eucalyptus/cloud
BEN Network elements across multiple layers
Dynamic circuit services (e.g., NLR Sherpa)
OpenFlow
Testbeds (ViSE, Kansei/NetEye, DOME)
• Integrated resource brokering (policies and federation)
• Extensible, future-proof, standards-based declarative resource
descriptions
– Drives allocation and coordinates stitching (limit “baked in” substrate assumptions)
• Configure network topologies using native dynamic circuit services
• Cloud integration and multi-domain cloud control
• Open identity management and authorization
Sponsored by the National Science Foundation
08/26/2010
2
Milestone & QSR Status (ORCA-BEN)
ID
Milestone
Status
On
Time?
On
Wiki?
GPO
signoff?
S2.a
Release 2.0 ORCA code to projects
Bella 2.0 release done on 03/14. COD
deprecated. NLR Sherpa handler, XML-RPC
ProtoGENI controller, actor registry, enhanced
stitching support, Eucalyptus handler and policy
Late
Yes
Yes
S2.b
Release 2.1 ORCA code to projects
Bella 2.1 release being readied to be done this
week (08/23). Numerous bug-fixes, restructured
network drivers, actor NDL support, registry NDL
support, OpenFlow support
Late
Yes
No
S2.c
Release 2.2 ORCA code to projects
Bella 2.2 final release. Expected Euca 1.6.x
support (vms with mutliple interfaces), associated
handler, bug-fixes
Due
09/30
Yes
S2.d
Release 2.x ORCA code to projects
Bella 2.2 is the last Spiral 2 release
Due
09/30
Yes
S2.e
Operate, extend clearinghouse
CH with broker and actor registry operational at
http://geni.renci.org:8080/orca and
http://geni.renci.org/actors.php
Early
Yes
S2.f
GMOC access to clearinghouse
Details of actor registry API communicated to
GMOC
Due
09/30
Yes
S2.g
Cluster plan for VLANs between testbeds
Connectivity between Cluster D members.
Umass, Ohio State, Wayne State connected to
StarLight, LEARN is awaiting switch installation
On time
Yes
S2.h
BEN testbed access by GENI users
Several pre-GENI-experimenter workshop
experiments run on BEN. GENI IMF experiments
demonstrated. We are doing our own experiment
outreach. BEN has little usable edge substrate.
Late
Yes
Sponsored by the National Science Foundation
08/26/2010
Yes
Yes
3
Milestone & QSR Status (ORCA-BEN)
ID
Milestone
Status
On
Time?
On
Wiki?
GPO
signoff?
S2.i
BEN testbed access from remote
sites
Experiments on cross-layer protocols between Columbia and
NCSU. BEN has little usable public edge substrate.
Late
Yes
S2.j
VLANs from BEN to backbone
BEN has direct NLR FrameNet connection. Sherpa support
integrated into ORCA.
On time
Yes
S2.k
Integration w/ GUSH
Interoperate with GUSH tools. An XML-RPC plug-in
controller is being developed/enhanced for use by GUSH.
Late
Yes
S2.l
Experiments on BEN and other
testbeds
Several demos run between BEN and ViSE (GEC7 and
GEC8)
Late
Yes
S2.m
POC to GENI response team
Chris Heermann
Late
Yes
Yes
S2.n
POC to GENI security team
Chris Heermann
Late
Yes
Yes
S2.o
Contribution to GENI outreach
Chase helped organize Tridentcom; Held discussions with
multiple experimenter candidates (e.g. Xiaowei Yang (Duke),
Don Smith, Kevin Jeffay, Jasleen Kaur (UNC CH));
continuing discussions with SNE UvA group.
Due
09/30
Yes
QSR: 4Q2009
Submitted/Approved
On Time
Yes
Yes
QSR: 1Q2010
Submitted/Approved
On Time
Yes
Yes
QSR: 2Q2010
Submitted/Approved
On Time
Yes
Yes
Sponsored by the National Science Foundation
08/26/2010
Yes
4
Milestone & QSR Status (ORCA-AUG)
ID
Milestone
Status
On
Time?
On
Wiki?
GPO
signoff?
S2.a
Release 2.0 ORCA code to projects
Bella 2.0 release done on 03/14. COD removed. NLR
Sherpa handler, XML-RPC ProtoGENI controller, actor
regustry, enhanced stitching support, Eucalyptus handler
and policy
Late
Yes
S2.b
Release 2.1 ORCA code to projects
Bella 2.1 release being readied to be done this week.
Numerous bug-fixes, restructured network drivers, actor
NDL support, registry NDL support, OpenFlow support
Late
Yes
S2.c
Release 2.2 ORCA code to projects
Bella 2.2 final release. Expected Euca 1.6.x support (vms
with mutliple interfaces), associated handler, bug-fixes
Due
09/30
Yes
S2.d
Release 2.x ORCA code to projects
Bella 2.2 will be the last release for Spiral 2
Due
09/30
Yes
S2.e
Single registry of brokers
Actor registry available from Bella 2.0
Early
03/14
Yes
S2.f
Query broker for available resources
Available as part of core ORCA functionality. Extended to
support NDL in Bella 2.1 upcoming release
Late
(07/20)
Yes
S2.g
Broker authorization based on attributes
from Shibboleth
Demonstrated at GEC8
Late
Yes
S2.h
Eucalyptus VM provisioning
Demonstrated at GEC7 and GEC8. ORCA provisions VMs
using EC2 interface and attaches them to a given VLAN.
On Time
Yes
Yes
S2.i
First ontology workshop
Held in conjunction with GEC7
On Time
Yes
Yes
S2.j
First draft of ontology schema
Documented on http://geni-orca.renci.org
On Time
Yes
Yes
S2.k
Second ontology workshop
Held in conjunction with GEC8
On Time
Yes
Yes
Sponsored by the National Science Foundation
08/26/2010
Yes
Yes
5
Accomplishments 1:
Advancing GENI Spiral 2 Goals (1/2)
• Continuous Experimentation
– Early experiments for pre-GENI-experimenter workshop
– Early IMF experiments
– Joint ViSE/BEN demos of sensor/cloud integration
• Integration
– Integrated DOME, ViSE, Kansei/NetEye testbeds
• Instrumentation and Measurement
– Closely working with IMF, ERM and LEARN to run experiments on
BEN (incremental demos at GEC7 and 8; full demo at GEC9)
Sponsored by the National Science Foundation
08/26/2010
6
Accomplishments 1:
Advancing GENI Spiral 2 Goals (2/2)
• Interoperability
– Developing ProtoGENI/AM-API (XML-RPC) ORCA controller
• Subject to resource representation conversion constraints
• NS2->NDL converter exists, ProtoGENI RSpec-> NDL being developed
• Identity/authorization is an issue for AM-API
– Resource representation workshops
• Identity Management
–
–
–
–
Planning for/with Shibboleth
Demonstrated Shibboleth “edge” integration
SFA 2.0 opens de facto GENI standard to external IdPs
Relationship to ABAC
Sponsored by the National Science Foundation
08/26/2010
7
Accomplishments 2:
Other Project Accomplishments
•
We are pursuing an alternative CF vision that supports GENI long-term goals
and is practical, inclusive and sustainable.
–
GENI as advanced multi-domain deeply-networked IaaS cloud orchestration
•
•
•
•
Open substrate integration:
–
–
•
Deployed ORCA-controlled switch at StarLight/iGENI to inter-connect Cluster D
Also enables connections to ESNet and I2 ION
Multi-domain provisioning using dynamic circuit services:
–
•
Example Eucalyptus integration demonstrates how GENI can use “ExoGENI” substrates
OpenFlow integration
Connectivity:
–
–
•
Integrate with other substrates without owning them or requiring dedicated resources.
Leverage standard provisioning interfaces
Declarative resource representations (NDL+ ontology)
Joint demos with ViSE and iGENI/StarLight
Building on declarative W3C-standard based resource descriptions
–
Policies, queries, format converters
Sponsored by the National Science Foundation
08/26/2010
8
Issues
• SFA 2.0 vs. GENI AM API 1.0 conflict
– Settling on AM API 1.0 as the basis for interoperability conflicts with our milestones
(e.g. Shibboleth integration and others), our development path, and GENI
standardization path
• Need for open substrate
– CFs living above substrate, not “baked on” is the best guarantee of interoperability
– Provides easy path for future new substrate integration
• Virtualization Models
– GENI should leverage industrial-strength virtualization
– Performance of VT for deeply-networked applications an issue (e.g. SR-IOV)
– Support for bare-metal provisioning still useful/essential
• Identity/authorization issues are a barrier to interoperability
– These should be factored out of CF and run as an external service, rather than
reimplemented in each CF and managed independently for each testbed.
Sponsored by the National Science Foundation
08/26/2010
9
Plans
•
•
What are your plans for the remainder of Spiral 2?
– Consolidation and bug fixes
– Preparing for GEC9 demos supporting experiments
– Production testbed (and finding funding)
The GPO is starting to formulate goals for Spiral 3. What are your thoughts
regarding potential Spiral 3 work?
– More open substrate integration (ORCA-BEN)
• ESNet, ION, MAX
• xCAT
–
–
–
–
–
–
Enhanced Shibboleth integration (ORCA-AUG)
NDL extensions, RSpec -> NDL conversion tools (ORCA-BEN)
User experiment tools (Gush, others) (ORCA-BEN)
Complex topology embedding (ORCA-AUG)
Monitoring and testing against deployment (ORCA-BEN)
“Virtual autonomous systems” on shared infrastructure
Sponsored by the National Science Foundation
08/26/2010
10