Data Plane Measurements
Deniz Gurkan
June 26th, 2009
GENI Spiral 1: 5 Control Framework Clusters (29 Projects)
Cluster A
DETER
Trial
Integration
Cluster B
PlanetLab
Enterprise
GENI
GUSH Tools
Cluster C
Cluster D
ProtoGENI
ORCA/BEN
Virtual Tunnels
Vehicular
Mobile Network
CMU Testbeds
Instrumentation
Tools
Sensor/Actuator
Network
Kansei Sensor
Network
Measurement
System
Provisioning
Service
PICK ONE
Studies
Programmable
Edge Node
GENI Meta
Operations
Million Node
GENI
Security
Architecture
Regional
Opt-In
Data Plane
Measurements
Digital Object
Registry
Optical Access
Networks
GENI at 4yr
Colleges
Cluster E
Mid-Atlantic
Crossroads
GpENI
SPP Overlay
Hosting Nodes
D. Gurkan
Orbit
Framework
Embedded
Real-time
Measurements
WiMAX
2
Outline
1.
2.
3.
4.
Review all Substrate Technologies*
Embedded Measurements*
Milestones
Suggested External Measurements
a. Desired Attributes: networking
b. Desired Attributes: reconfiguration and
programmability
c. An example case
* Based on the “Spiral-1 Substrate Catalog” GPO, J. Jacob.
D. Gurkan
3
C–A
Review all substrate technologies
Substrate
Network Infrastructure
TIED
Routers and computers
Cluster B
Mid Atlantic
Network
GpENI
Regional optical network, 10 Gbps DWDM
optical nodes, 10 Gbps Ethernet switches,
computer servers
Regional optical network, 10 Gbps optical
switches, 10 Gbps Ethernet switches,
Programmable Routers, Site-specific
experimental nodes
Enterprise GENI Campus wide programmable Ethernet switches
Planet Lab
SPP Overlay
D. Gurkan
High performance overlay hosting nodes,
netFPGA cards
4
Cluster C
Review cont.
D. Gurkan
Substrate
Network Infrastructure
CMU Testbeds
Small scale Emulab testbed,
Residential small form-factor
machines, Wireless emulator
Proto-GENI
Programmable Ethernet Switch,
PC’s with NetFPGA cards
Programmable Edge
Node
Intel 2855 network processor based
programmable edge node
Measurement System
PC-based IP Packet monitors, Data
Storage Systems
5
Review cont.
Substrate
C- E
Cluster D
BEN
D. Gurkan
Network Infrastructure
Regional optical network, optical fiber switch, 10
Gbps optical transport equipment, 10 Gbps
Routers/Switches, Site-specific experimental
nodes
DOME
Metro mobile network, variety of wireless
interfaces, devices, wireless access points.
ViSE
Multi Sensor (camera, radar, weather station)
Network
Kansei Sensor
Networks
WiMAX
Orbit
Wireless sensor networks
IEEE 802.16e WiMAX base-station
Heterogeneous and Mobile Wireless Testbeds
6
Measurements
1. Embedded Measurements: Readily available at the
multi-purpose nodes (network nodes, other boxes)
where transparency is dependent on the
manufacturer’s design. Access is sometimes
restricted to only through the vendor’s API where
there is no direct access to the sensors (refer to
GIMS).
2. External Measurements: Depending on needs
assessment in a GENI control framework, external
measurement instruments are investigated.
D. Gurkan
7
Example Embedded Measurements
Ciena CN 4200:
• Bit error rate, optical
power
• Protocol specific
performance monitoring
(Remote Monitoring
(RMON) for Ethernet
connections)
• Performance monitoring
on network services
2 x 10/100BaseT Ethernet
ports for remote
connectivity, and a RS-232
serial port for local craft
access
GpENI
D. Gurkan
Adva FSP 3000:
• Optical performance
monitoring
• SONET/SDH, physical layer ,
service availability
• PM threshold setting
• PM threshold crossing alerts
• FEC counters
• SNMP traps for alarm
monitoring
• Fault Management
Ethernet , RS-232 serial cable,
SNMP, remote management via
in-band channels
Mid-Atlantic
Network
Infinera DTN:
• Full digital access to
the optical layer and
performance monitoring,
fault management.
Ethernet- based craft
interface, remote
connection via the inband management
channel carried by the
Optical Supervisory
Channel (OSC)
Proto-GENI &
BEN
8
Example Embedded Measurements
Polatis 24 Port Fiber Switch in BEN
• Monitor the optical power on a per
port basis
• Ethernet, serial interface (RS232), or
GPIB.
NOTE: Measurement Applications
Enabled by the Fiber Switch
• Receiver and transmitter testing
• BER
• Jitter and protocol testing
Source: http://www.polatis.com/solutions/test_measurement.asp
D. Gurkan
9
Embedded Measurements
Cluster B
• Mid Atlantic Network
– Adva Optical Network ( FSP 3000):
Optical performance monitoring,
FEC counters, SNMP traps for alarm
monitoring
– Nagios: Monitors network Health ,
round trip time between nodes
– Ethernet Switches: Packet counters
and error counters
– Cricket: Graphing of network
performance and optical
performance monitoring data.
•
•
Enterprise GENI
– OpenFlow: Gather statistics at a
per flow entry on
routers/switches.
•
SPP Overlay
– PlanetLab mechanisms for
auditing outgoing traffic.
– Generates real time charts of
traffic associated with the slice.
– NetFPGA: Programmable
hardware
GpENI
– Ciena CN 4200: Bit error rate ,
optical power and performance
monitoring.
D. Gurkan
10
Embedded Measurements
Cluster C
•
CMU Testbeds
Cluster D
•
– Polatis 32 fiber optical switch: Optical
power measurement
– Infinera DTN: Full digital access to the
optical layer , digital performance
monitoring
o Interface monitoring ,tcpdump/pcap and
Nagios-style monitoring of machine
availability.
•
Proto-GENI
– Ethernet switches: Packet counters and
error counters
– Net FPGA: Programmable hardware
•
Programmable Edge Node
– Network Processor: Flow Statistics
•
•
D. Gurkan
DOME
– Umass Server: SSIDs and BSSIDs, signal
strength, noise level, and type of security
•
Vise
– NetCDF files: Raw reflectivity and
Voltage data
Measurement System
– Capture packets associated with the
experiment.
– System utilization measurements via
SNMP
– Activity logs
BEN
•
Kansei Sensor Networks
– Kansei Doctor: measures the number of
available nodes, their health, radio link
quality and networking metrics relevant
for sensor networks.
11
Embedded Measurements
Cluster E
•
WiMax
– NEC WiMax Base Station
o PHY : Access mode, Frequency, DL:UL ratio, Channel BW, FFT size,
Frame duration, TX output Power and # of sectors.
o MAC: Head compression, ARQ, MBS support, Resource
management
o Network: IP protocols, Bridging/Routing and Packet handling.
– Orbit Measurement Library
o Record per flow or per packet measurements
o Layer 2 and 3 measurements
D. Gurkan
12
Milestones
Milestones Delivered
• Review all substrate technologies in spiral-1
• Document embedded measurement capabilities
As more substrate input is delivered to the substrate workgroup, we will
revisit these deliverables.
Future Milestones
• Identify external measurement equipment due May 30th 2009
• Describe the network connections for external measurements due
August 31st , 2009
D. Gurkan
13
Some Notes
on Embedded Measurements
•
•
Control frameworks have been busy with preparing for
the first prototype implementations.
Embedded measurements (that are included in our
report) are not all available in prototype
implementations:
–
–
•
Integration of measurement resources as components
into the aggregate manager may not be present.
Need-assessment for the embedded measurements has
not been a priority.
Most embedded measurements have been in the
control plane serving layer 2/3 monitoring needs.
D. Gurkan
14
External Measurements
Wireless
Optical
1.
1. Anritsu MP1800A: Signal
Quality Analyzer at 40 Gbps
with Remote control
Ethernet/GPIB
2. JDSU T-BERD/ MTS-8000: Full
40 G testing, 1550 nm optics
(per ITU-T and GR-253
standards), G.826 and G.828
performance measurements
with configuration capability
on application modules.
3. Centellax TG1B1-A: 10G BERT
with GPIB control Interface.
2.
3.
4.
Anritsu MS269xA Signal
Analyzer with Mobile WiMAX
Measurement Software:
IEEE802.16e RF signal
characteristics
JDSU G7104A Multimaster
Base Station Tester: Test and
measure CDMA,
WCDMA/HSPDA systems
JDSU GC7105A Base Station
Analyzer: Test and
maintenance of wireless
communication systems
JDSU GC7106A RF Analyzer:
Test and measure RF
communication systems
D. Gurkan
15
Desirable Attributes
Networking of Instruments
Re-configuration & Programmability
•
•
•
•
Remote access
mechanisms
Flexible API to interface
with the aggregate
managers across GENI
Storage
D. Gurkan
•
•
Configure measurement
parameters
Re-program a
measurement resource
Slice a measurement
instrument for multiple
user access
16
Networking of
External Measurement Instruments
•
•
Remote access mechanisms: Ethernet, USB, other –
include a computer (server) at each instrument site
Interface to the instrument: (programmable) vendor
API/drivers – couple with GENI control frameworks
–
–
–
Planetlab interface, rspecs
ORCA interface, NDL
ProtoGENI interface, Emulab
•
Storage (experiment execution – data collection and
analysis*): on-instrument, on-network, local, at
researcher’s access point, ???
* “Lifecycle of a GENI Experiment”, GPO, V. Thomas.
D. Gurkan
17
Re-configuration
of External Measurements
• Configure measurements as you can register/plan
(resource discovery, tool discovery, etc.)* an
experiment – what parameters are measured at
which measurement resource at what granularity.
• E.g.:
– optical power per wavelength channel,
– at input of Infinera DTN at UH for the link between UH and
Rice,
– at a sampling frequency of 60 Hz.
• Reconfiguration availability: e.g. change sampling rate
(need to know the range of configuration)
* “Lifecycle of a GENI Experiment”, GPO, V. Thomas.
D. Gurkan
18
Programmability
of External Measurements
• Re-program a measurement resource according to
what your analysis requirements dictate:
– Local analysis and then report instead of continuous raw
data reporting
– Upload custom measurement software to instruments
• Slicing of a measurement instrument similar to a
resource being sliced – multiple researchers can
access the same or different measurement
parameters at the same time
D. Gurkan
19
Example Capabilities:
An optical measurement instrument
• Bit error rate
• Polarization Mode
Dispersion testing – PMD
delay, PMD coefficient and
second order values.
• Chromatic Dispersion
testing – OTDR based
method and phase shift
method
• DWDM: Optical SNR, power
and wavelength in the S, C,
L bands.
• Optical spectrum
analyzer(OSA) module
D. Gurkan
• Network connection to the
instrument
–
–
Dedicated link
In-line
• Link-based measurements:
the basis for end-to-end?
–
–
–
–
Infinera
Ciena
ADVA
Fujitsu
• Update frequency of
measurements
• Desired sampling rate
• Event reporting
• Other exotic analysis
20
Thank you
• Questions?
• Suggestions?
D. Gurkan
21