MASSACHUSETTS INSTITUTE OF TECHNOLOGY
HAYSTACK OBSERVATORY
WESTFORD, MASSACHUSETTS 01886
Telephone:978-692-4764
Fax:
781-981-0590
6 March 2002
TO:
Distribution
FROM:
Alan R. Whitney
SUBJECT:
4 March 2002 e-VLBI telecon summary
Attendees:
Lee Foster, Pat Gary, Chuck Kodak, Kevin Kranacs, Bill Wildes – GSFC
Tom Lehman, ISI
Steve Bernstein, Lorraine Prior – Lincoln Laboratory
Richard Crowley, Kevin Dudevoir, Hans Hinteregger, Arthur Niell, Alan Whitney – Haystack
Observatory
This telecon is one of an ongoing series of telecons to prepare for gigabit/sec e-VLBI demonstrations
between NASA GSFC and MIT Haystack Observatory using a combination of network facilities
including all or part of Glownet, Bossnet, ISI-E, SuperNet, Max and GSFC/HECN.
Status Reports
The attached figures of the e-VLBI path have been updated to reflect current status and are pretty
much self-explanatory; critical status items are indicated in red. In addition, the following comments
are relevant:
− Lorraine reported that the Juniper router is now in place at E7 and that connection E6 will be
made as soon as administrative details are cleared, including changing IP addresses of the
Haystack test machine. Will try to get this all done by end of this week. Glownet usage for eVLBI will be coordinated through Lorraine, who has access to the LL radar schedule; Lorraine
will suggest ‘windows of opportunity’. Bossnet scheduling will be done on Bossnet activity
calendar at www.ngi-supernet.org. IP-address changes will be coordinated between Kevin D.
and Lorraine.
− 3rdλ on link D1 still awaiting shipment from Cisco; now scheduled to ship 8 March, but will
have no effect on e-VLBI work.
− Tom reported that connection G9 is now in place at ISI-E with an OC-48 path from Lincoln
Lab. Test workstation G7 is now in place. Kevin will be in touch with Tom to get the
necessary details.
− Alan will send a query to Jerry asking when MAX plans to place test workstation H5 at ISI-E.
− Pat reported that GSFC has loaned MAX/UMCP a Summit 5i box (H10) which will be
minutes09.doc 3/8/02
1
connected between H7 and J5 to complete a jumbo-frame-capable path from H7 to J5; final
connection of this link will be made with days to a week or so. A test workstation (J1) will
likely be moved to H10 as shown in Figure 2.
− Pat reported that they have on 2-week loan from Cisco a pair of 10GigE ‘blades’ to add a
10GigE λ to the two existing GigE λ’s on the J6 link between UMCP and GSFC Bldg 28. The
link was tested by creating a GigE VLAN between Mac G4 GigE test workstations plugged
into Cisco 6509’s at J5 and K1, with the VLAN connected to loop back and forth 8 to 16
times between J5 and K1, creating a traffic multiplier on the 10GigE of the same value.
Results showed performance at ~8GigE; a similar test with back-to-back Cisco 6509’swill be
done this week to see if there is any change in results. Pat will e-mail results to group. Pat
estimates cost of each 10GigE blade is $40-70K, but prices should decline rapidly; Pat will
send info on 10GigE blades to Alan. Steve indicated that Jim Calvin has used a similar trick
at LL to test 10GigE performance.
− The fiber of the K7/L1 link is now installed and has been tested by the installer. Summit 5i
switch L2, which is currently at Bldg 28, is ready to be moved to GGAO; should happen very
soon. The G4 Mac at K6 is currently being used in 10GigE testing, but will be moved in ~1
week to GGAO for testing. Kevin will coordinate IP addresses, etc with Lee Foster and Bill
Fink.
− Pat suggests using a performance tool named mrtg (version 2.9), which supports 64-bit
counters (earlier versions had only 32-bit counters).
− Tom reported that link between ISI-E and LL may be upgraded to 10GigE, possibly sometime
this summer. Additional equipment would be need to upgrade path from LL to Haystack.
− Tom indicated ISI-E does not have good connectivity to StarTap due to lack of funding; might
be possible to connect to Abilene, but only on case-by-case basis for demos; would need
funding to make permanent connection. Contacts might be Paul Love or Steve Corbato, both
of Internet2.
− A Mark 5 system could be ready to send to GGAO in a couple of weeks.
− Pat indicated that SAN folks at GSFC note that GigE network nicely matches the speed of
existing FibreChannel connections; there is some interest in creating a SAN over IP using the
GigE links. Also investigating iSCSI gateway/router technology.
GigE Performance Tests
Kevin D. is working on crafting a performance test that more closely emulates the e-VLBI
application; hope to have something ready to test in a couple of weeks.
Scheduling Issues
Haystack will coordinate with Steve, Lorraine and the WNS people at LL for use of Glownet.
Bossnet activity calendar will be used to schedule Bossnet usage.
Action Items
Lorraine: Will inform Kevin and Alan when connection E6 is put in place.
Pat: Send 10GigE info to Alan.
minutes09.doc 3/8/02
2
Kevin: Will coordinate with Lorraine, Tom and Lee to get IP addresses and accounts on test
workstations.
Next telecon
Next telecon will be Monday, 25 March 2002 at 2 pm.
xc:
minutes09.doc 3/8/02
Steve Bernstein, LL
Jim Calvin, LL
Lorraine Prior, LL
Leslie Weiner, LL
Herbert Durbeck, GSFC
Lee Foster, GSFC
Pat Gary, GSFC
Chuck Kodak, GSFC
Kevin Kranacs, GSFC
Paul Lang, GSFC
Aruna Muppalla, GSFC
Bill Wildes, GSFC
Dan Magorian, UMCP
Tom Lehman, ISI
Jerry Sobieski, Max
Richard Crowley, Haystack
Kevin Dudevoir, Haystack
Hans Hinteregger, Haystack
Arthur Niell, Haystack
Joe Salah, Haystack
3
Westford Antenna
Millstone RPE Bldg (Lorraine)
Dedicated no scheduling
GigE
WS/
Mark 5
1
A2
A1
Summit
1i
GigE
8
Summit
A4
5i
A3
Dedicated no scheduling
28-1A
14
GigE
GigE
Dell Poweredge 2500
C3
16
Summit
15
B6
B5
28-1B
WDM
GigE
5i
13
WS/
Mark 5
GigE
B2
B1
B4
GlowNet
Amp
D3
D2
Lincoln Lab (Lorraine/Steve/Jim)
Schedule to be
coordinated with LL
Connection to be made
week of 4 March 02
Cisco
1500
E3
GigE
Summit
E2
5i
E1
E4
Dell Poweredge 500SC
(provided by Haystack)
E5
Test
WS
OC-48
E6
(Shared with LL on
scheduled basis)
Cisco
1500
GigE
Congress St
Boston
B3
WDM
LL
C2
Haystack Correlator
WS/
Mark 5
Schedule to be
coordinated with LL
C1
To be upgraded from
2l to 3l - awaiting parts from Cisco
(2 GigE + 1 OC-48)
GlowNet
D1
Bossnet (Steve/Jim)
ISI-E
Scheduling on
Bossnet calendar
E7
Juniper OC-48
1310
M20
E8
GigE
MIT
Campus
WDM
F1
155x
Amp
Amp
F2
E9
Other users (no control)
To be upgraded to OC-48
evlbi011.cdr
6 Mar 02
Figure 1: e-VLBI Path - Haystack to ISI-E
ISI-E (Tom)
Scheduling on
Bossnet calendar
MAX @ ISI-E (Jerry)
Need details
Test
WS
G7
Tuner
Bossnet
WDM
GigE
G6
Summit
5i
Switch
G5
G8
G6
GigE
H5
H1
G12
GigE
H2
GigE
H4
OC-48
Trans-
G2
ponder
OC-48
G9
G11
Juniper
M40
G3
OC-48
Borrowed OC-48
interface - may not
be able to keep
G10
No jumbo frames
H7
Juniper
M160
GigE
H8
GigE
H9
Primary e-VLBI path
J3
Test
WS?
J2
J1
Need details
H3
H6
Other users ( no control)
Cisco
4912
Switch
GigE
Summit
5i
H10
GigE
J5
J4
WDM
GigE
on loan from GSFC
H11
3l now is place 2 GigE plus experimental
10GigE (on loan from Cisco)
LuxN
J6
To be installed soon
LX (~14km)
GGAO/Bldg 201 (Pat/Chuck)
GSFC/Bldg 28 (Pat/Paul/Kevin/Bill F.)
GigE
K2
WDM
K3
K1
K6
K4
Summit
5i
GigE
Dedicated - no
scheduling necessary
LX (~5km)
K7
1310
GigE
L1
Test
WS
Temporarily located
in Bldg 28 - will be
moved to GGAO soon
GGAO Antenna Trailer (Bill W./Chuck)
Summit
5i
L2
K5
Test
WS
OC-48
Juniper
M160
MAX/UMCP (Jerry/Dan)
G4 Mac with
Yellowdog Linux;
need details
(Bill Fink)
No scheduling;
sufficient capacity
for e-VLBI
Backup plan
G1
Will try to schedule
either K2 or K3
exclusively for
e-VLBI experiment
MAX performance node;
need details
Test
WS?
GigE
L3
WS/
Mark 5
L4
K6A
Windows PC
(Lee Foster)
1600 ft of fiber
now installed
To be moved to GGAO
Figure 2: e-VLBI Path - ISI-E to GSFC/GGAO
Will be replaced
with Mark 5
evlbi012.cdr
6 Mar 02