GENI Meta-Operations Center
Spiral 2 Year-end Project Review
GlobalNOC at Indiana University
PI: Jon-Paul Herron
Co-PI: Luke Fowler
Staff: Camilo Viecco, Chris Small
Students: Nick Baker, Jeff Catania, John Meylor
8/30/10
Sponsored by the National Science Foundation
Project Summary
•
Goals for GMOC
–
–
–
•
Help GENI community define operational model
Provide system for collecting & sharing operational data with researchers and GENI operators
Provide useful GENI-wide operational visualizations and services
Spiral 2 Focus Areas
–
–
–
–
Additional Data collections (clusters and exemplar projects)
Cross-cluster Visualization
International Federated Visualization
Emergency Stop V1
Sponsored by the National Science Foundation
August 31, 2010
2
Milestone & QSR Status
ID
Milestone
Status
On Time?
On
Wiki
?
GPO
signoff?
GMOC: S2.a
Spiral 2 Prototyping Plans
Produced plan for Spiral 2 data collection & doc
review. Published S2 plans doc on wiki
Early
Y
Y
GMOC: S2.b
Prototype Manual Emergency
Shutdown
Performed shutdown drill with ProtoGENI,
creating slice, then requesting shutdown and
verifying results
Early
Y
Y
GMOC: S2.c
Prototype slice view of operational
data
Early
Y
Y
GMOC: S2.d
Revised concept of operations
Looking for feedback from GEC7 & GEC8, but ran
out of time at OMIS meeting, so revised with
limited feedback for now
>2 months
late &
complete
Y
GMOC: S2.e
Prototype S2 data sharing
Began sharing additional data with ProtoGENI,
have plans for ORCA & Openflow
Due 9/30
N/A
N/A
GMOC: S2.f
Prototype multi-cluster GENI-wide
visualization
Will Enhance visualization to show multi-cluster
slices in clear way
Due 9/30
N/A
N/A
QSR1
Quarterly Status report, S2Q1
On Time
Y
Y
QSR2
Quarterly Status Report, S2Q2
<2 months
late
Y
QSR3
Quarterly Status Report, S2Q3
<2 months
late
Y
Sponsored by the National Science Foundation
INSERT PROJECT REVIEW DATE
3
Accomplishments 1:
Advancing GENI Spiral 2 Goals
•
•
•
•
Continuous Experimentation: GMOC’s focus is on enabling end-to-end
support and operations for experiments crossing aggregates. Emergency
shutdown, and slice visualizations directly support operationalizing of GENI
prototypes
Integration: GMOC’s work integrates the operational information from multiple
projects. The work to visualize slices once they span clusters will have clear
benefits to GENI integration goals.
Instrumentation & Measurement: GMOC has actively participated in
Instrumentation and Measurement discussions and planning Spiral2, as a
potential user and contributor of measurement data.
Interoperability: GMOC doesn’t directly enable interoperability of control
frameworks, but the GMOC data format should allow interoperating clusters to
have interoperability of operational data as well.
Sponsored by the National Science Foundation
INSERT PROJECT REVIEW DATE
4
Accomplishments 2:
Other Project Accomplishments
•
•
•
•
Emergency Stop Process V1: Reached consensus on Emergency Stop Process, now
ready to implement
Slice data views: GMOC demonstrated first view
Portal Improvements: Several updates to GMOC portal
Data Collection improvements:
–
–
•
•
•
•
GpENI – opened up access for data collection, but depends on GMOC polling/collecting directly
ProtoGENI – Usage collections from HP switches, and topology via ProtoGENI API, but no slice
data
International Federation: Provided GMOC software package to K-GENI, helped get it
running, and updated software to allow for federated GMOC systems
R&E Networking interface: GMOC participated in the Quilt GENI conference, discussing
operational impact of GENI on the RON community, and the things RONs might need to
better support GENI
Instrumentation & Measurement: GMOC participated in the I&M workshop and
discussions, as a potential consumer and provider of measurement data, and to share
findings on formats and capabilities for data sharing
PerfSONAR workshop: GMOC participated in the PerfSONAR workshop, helping to
represent a potential use for PerfSONAR instrumentation of GENI
Sponsored by the National Science Foundation
INSERT PROJECT REVIEW DATE
5
Issues
•
Interactions with other projects:
–
–
–
–
–
–
–
•
EnterpriseGENI/Openflow: (not originally on the list) collecting topology and usage for
Openflow deployments. Also beginning to work with Openflow developers to open channel for
data on flows. Likely to use GMOC visualization for GEC9 demo of Openflow.
ProtoGENI: Good progress on Emergency Stop, and on gathering backbone data. Now
gathering topology via ProtoGENI API. Additional data will likely be very difficult. Slice data is
key, but ProtoGENI has said this will be difficult.
ORCA: Making some progress. API is available, and working recently. Investigating what data
is available through the API, and how difficult it would be to gather it
KanseiGENI: Have pointed us to ORCA to gather the info
Million Node GENI: don’t support GMOC data format. Have exported data, but data is not
useful (Node ID, but no IP address, location, or other capabilities)
GMULab: Slow responses, but slow progress
MAX: Unresponsive, multiple contact attempts
Many open operational questions remain:
–
–
Overall operational architecture needs consensus, even if not total consensus
Expectations for post-spiral3 support/operations remains murky
Sponsored by the National Science Foundation
INSERT PROJECT REVIEW DATE
6
Plans
•
Spiral 2
–
–
•
Demo for OpenFlow for GEC9
Initial investigation of ORCA’s API
Spiral 3
–
Additional Data Collection
•
•
•
•
–
–
–
–
INSTOOLS
OpenFlow
ORCA (depending on effort required)
ProtoGENI
Automated Emergency Stop with ProtoGENI
Better vis UI for large scale data
Better vis UI for inter-cluster slice view
How do we move from investigating, discussing, and collecting data to really operating (go
production)? Issues around maintenance, change expectations, operational communication
remain
Sponsored by the National Science Foundation
INSERT PROJECT REVIEW DATE
7