GIMI Update
Mike Zink
University of Massachusetts Amherst
GEC 13, Los Angeles, March 13th
1
Overview
•
•
•
•
Introduction
Goals
Initial focus
Current architecture
• Demo details
2
Introduction
• Develop and deploy the GIMI instrumentation and
measurement framework
• Capable of supporting needs of GENI experimenters and
GENI infrastructure operators
• Uses the ORBIT Measurement Library (OML) and integrated
Rule Oriented Data System (iRODS) as its basis
• Will provide libraries to instrument resources, to filter and
process measurement flows, and to consume
measurement flows
• It will use the iRODS data grid for archiving and further
processing
• Will include access control based on accepted GENI policy
and authorization mechanisms
3
Goals
• Provide easy-to-use I&M services for experimenters:
• deploying slices in GENI on selected types of servers, VMs and racks,
WiMAX installation, and sensor networks.
• interconnected by various types of network paths
• Provide comprehensive infrastructure measurement services
for infrastructure operators:
• deploying measurement slices on selected types of servers, VMs and
racks, and WiMAX installations
• interconnected by a various types of network paths In addition
• slices established by other infrastructure operators, or by
experimenters, can be authorized to gather data from the
measurement slices
4
Goals
• This project will build and operate two persistent services:
• the GENI Measurement Data Archive Service (i.e., iRODs)
and
• the GENI Experimenter Portal Service
• Collaborate with existing I&M Spiral 2 projects and GEMINI
5
Initial Focus
• Start with OML, and provides easy-to-use tools
for GENI environment
• I&M use cases for experiments:
– Default OML Client in nodes that gathers passive
measurements like INSTOOLS
– Provides basic node-to-node connectivity tests using
ping and Iperf
• Spiral 4 : ORCA servers, VMs and ExoGENI (RENCI)
racks, and WiMAX
• Spiral 5: protoGENI/Emulab servers/VMs and
InstaGENI (HP) racks
6
New Tools
• Introduces XML messaging service, with
pub/sub, in public IP space
• Introduces iRODS service for digital object
archive
7
Current Architecture
Experimenters may register
portals on their I&M
services, so that they can be
discovered and used by
Operators and (when
permitted) Experimenters
Experimenter A
gpo229
Experimenter A, Slice 029
(or Operator AA, Infrastructure Measurement Slice 0029)
Linux Server
Linux Server
** Can Lab
Portal Service
be used by
GEMINI tools?
Experimenter A User Workspace (persistent)
OML Server and Results Service (MAP)
on ORCA servers/VMs/racks
Access and Backbone
Experimenter A User
Workspace (persistent)
Node 1
GUSH+
OML
Intfc
MD can be
pushed directly
to persistent
OML server
Node n
Results
pdf
Analyze
Exper App
Exper App
OMF RC
OMF RC
OMF RC
AM API
assign resources
OML
Client
(MP)
ns3
load topology
shell
shell
ssh
Load images
OML
Client
(MP)
shell
SQL
(Control Nwk)
Measurements Orchestration (MO)
Web
OML
(Control Nwk)
How to customize OML
client?
Agg Mgr
Agg Mgr
OMF
Orch
Meas
Node n+1
OML Server (MC)
OML
Intfc
Experiment Control
Services may run
locally or in Lab Portal
Service
Experimenter’s slice must
include:
* OML Client in each
node
* OML Server in separate
node/VM
OMF RC
How can this be done?
shell
SQL
DB
MDOD
slice029
perfSONAR
Intfc
** perfSONAR
interface can be
added to share data
with others, via
GEMINI tools
Analyze
Experimenter Z User Workspace (persistent)
Can iRODS
provide MDOD
Registry
functions?
SQL
(Control Nwk)
iRODS Digital Object Archive Service (persistent)
Analyze
functions can
be added
SQL
(Control Nwk)
Experimenter A Partition (persistent)
Directory
XML Messaging Service
(persistent)
++ Current GENI WiMAX sites utilize
OMF and OML; see sheet 3b).
The configuration of these sites must be
made consistent eith the GIMI I&M toos
configuration.
XMPP
XMPP Server in
public IP space,
with pub/sub, is
reachable, and is
used to carry
OMF messages
Analyze
functions can
be added
MDOD Creator/Editor
OML
(Control Nwk)
What is in basic OML
client? like INSTOOLS?
OMF
Orchestrate
Exper
Experimenter’s slice is
NOT persistent; must
send data to portal or user
workspace service before
slice ends!
Web
SQL
DB
To allow authentication of entities (i.e., OML
Client service) that connect to XMPP server,
each entity needs to: hava name; hold a
private key; and have its name and public key
in an Object Registry. How can this be done?
In particular, the WiMAX sites utilize a
Control Network that is protected, i.e.,
available only to htose who are loggedln.
How can this be done?
++ Default assumption:
Measurement Data (MD) traffic is light,
and is carried on the Control Ntwk
++ Option if MD traffic is heavy, e.g.,
sensor traffic or port monitoring traffic.
Then need to carry traffic in the Data
Network (on a VLAN)
Then, need an OML Server with an
OML Intfc on the Data Ntwk.
Then may use IPFIX, or other protocol
suited to high traffic flows
** iRODS can be used by
all GENI I&M tools for user
workspace and archive
functions, including
GEMINI tools
SQL
DB
MDOD
slice029
Archive
MDOD
containes policy
for archive to
share objects
with others
Web
Lab Notes?
Can iRODS store
other experiment
objects, i.e., lab
notes and
images?
MD Objects
slice029
Images?
Experimenters may transfer some of
their measurement data objects to an
archive service, so that they will be
available for a long period of time.
Experimenter Z PartitionExperimenter
(persistent) can set policy so that
objects may be searched by and shared
with Researchers.
8
Demo Preview
Experimenter Node
Experimenter A User Workspace
(persistent)
RENCI ORCA Cluster
File System
Experimenter A
gpo229
GENI
Exp Mgmt
API
Key, Certificate,
Credential Store
OMF EC
orchestrate
experiment
application
Gush
configure
resources
acquire
OMNI
resources
OMF
orchestrate
ExperApp
Gush
manage
processes
ssh
load software
(option 2)
configure software
GENI AM API
acquire resources
load image/software
(option 1)
setup connectivity
FLUKES can be used as an
alternative to OMNI to
acquire resources, etc.
Node 1
Exper App
GENI AM API
(for all ORCA/ExoGENI sites)
acquire resources
load image/software (option 1)
setup connectivity
(including inter-site)
Node n
Exper App
OMF RC
Gush Client
shell
Agg Mgr
Node options supported:
a) servers, at some sites
b) VMs, at all sites
OpenStack, with NEuca
c) Many images
from “ImageProxy” web server
Duke ORCA Cluster
UNC ORCA Cluster
FLUKES
Native ORCA API
(for all ORCA/ExoGENI sites)
acquire resources
load image/software (option 1)
setup connectivity
(including inter-site)
Data Plane (VLAN/OF
connections)
Access
d) barebones images
use wget to load, past boot
debian 6G – 10G (file system
size)
centos
ubuntu
red hat
sparse images (room to load
via wget)
Backbone
shell
e) custom images with app
node with OML clients for:
basic host; ping; iperf
OML server, with presentation
UoH ORCA Cluster
RENCI ExoGENI Rack
Then, OMNI can retrieve the
manifest in GENI rspec.
BBN ExoGENI Rack
Control Plane
(IP backbone/Internet)
9
Demo Details
Experimenter Node
Experimenter Tools
• OMF/OML
• Gush/Omni
• Flukes
Experimenter A User Workspace
(persistent)
shell
File System
Experimenter A
gpo229
Key, Certificate,
Credential Store
OMF EC
orchestrate
experiment
application
Gush
configure
resources
acquire
OMNI
resources
FLUKES
Native ORCA API
(for all ORCA/ExoGENI sites)
acquire resources
load image/software (option 1)
setup connectivity
(including inter-site)
FLUKES can be used as an
alternative to OMNI to
acquire resources, etc.
Then, OMNI can retrieve the
manifest in GENI rspec.
Flukes
10
Demo Details
Access
Node 1
Exper App
Node n
Exper App
OMF RC
Gush Client
shell
Agg Mgr
Node options supported:
a) servers, at some sites
b) VMs, at all sites
OpenStack, with NEuca
c) Many images
from “ImageProxy” web server
Duke ORCA Cluster
UNC ORCA Cluster
d) barebones images
use wget to load, past boot
debian 6G – 10G (file system
size)
centos
ubuntu
red hat
sparse images (room to load
via wget)
Backbone
ExoGENI
• Flukes to set up
topology and allocate
resources
• Gush/Omni to execute
experiment
• OML-based Iperf
measurement
RENCI ORCA Cluster
e) custom images with app
node with OML clients for:
basic host; ping; iperf
OML server, with presentation
UoH ORCA Cluster
RENCI ExoGENI Rack
BBN ExoGENI Rack
11
Demo Details
iRODS
• OML sqlite3 database
stored in iRODS
• iRODS installations at
RENCI and Umass
(NICTA online shortly)
• iRODS catalogue (iCAT)
at RENCI
iRODS Archive
NICTA
RENCI
iCAT
UMass
Vault
Vault
Vault
12
Demo Details
R-based visualization
• Visualize Iperf
measurement results
• Constant update
• Now on web page
later through portal
13
Demo Details
IREEL
Portal:
• Based on NICTA’s Internet Remote Emulation
Experiment Laboratory (IREEL)
• Replace remote controlled network emulator by
GENI resources.
14
Demo Details
Multi-CF Demo:
• OMF/OML-based
• Uses ProtoGENI, PlanetLab, ExoGENI/ORCA,
EC2 resources
EC2
OML
Server
Iperf, Nmetric
Iperf, Nmetric
OML-based
Iperf client
Iperf, Nmetric
15
GEC 14 Tutorial
• Plan to offer first GIMI tutorial at GEC 14 in
Boston
• Get feedback from experimenter at demo
tonight
• Choose most interesting case (based on
feedback)
• Make use of tools that have been used in past
tutorial (e.g. Gush, OML)
16
Thank You
Questions?
17