MASSACHUSETTS INSTITUTE OF TECHNOLOGY
HAYSTACK OBSERVATORY
WESTFORD, MASSACHUSETTS 01886
Telephone:
Fax:
978-692-4764
781-981-0590
1 May 2003
TO:
Distribution
FROM:
Alan R. Whitney
SUBJECT:
28 April 2003 e-VLBI telecon summary
Attendees:
Lee Foster, Pat Gary, Kevin Kranacs, Paul Lang, Bill Wildes – GSFC
Tom Lehman – ISI-E
Russ Roberge, Peter Schulz – MIT Lincoln Lab
Kevin Dudevoir, Hans Hinteregger, David Lapsley, Arthur Niell, Alan Whitney – Haystack
Observatory
This telecon is one of an ongoing series of telecons to prepare for gigabit/sec e-VLBI demonstrations
between NASA GSFC and MIT Haystack Observatory using a combination of network facilities
including all or part of Glownet, Bossnet, ISI-E, SuperNet, Max and GSFC/HECN.
ACTION ITEMS ARE HIGHLIGHTED IN RED.
Dell 5224 GigE Switch Testing
Russ reported results of preliminary testing on the Dell 5224 switch (identical to SMC TigerSwitch
8624T according to PC Magazine, 27 May 02, p.116). He found that the optical ports passed
throughput testing with no problems, but the copper ports always failed the first two throughput tests
and worked thereafter. A new firmware update has been obtained which may fix this problem; Dell
has also been contacted directly. Further testing will be done. Russ will write and distribute a report
on the results of this testing. Tom asked if latency and jitter testing has been done; Russ will look
into the possibility.
Glownet/Bossnet
− Peter reported LL is continuing negotiations with Qwest for lease of Bossnet.
− Additional testing of OC-48 is pending; Tom expects he will be able to support this testing
next week.
− If Bossnet goes away, Haystack will be hard-pressed to find an affordable alternate
connection to Abilene. Technically, it is possible for a ‘Haystack wavelength’ to be stripped
off Glownet at Congress St where it could connect to NOX, but Haystack would have to bear
the charges for the separate connection to NOX (estimated at ~$100K/yr for a GigE
connection).
− LL maintains a throttled (to ~400Mbps) GigE connection to NOX at Congress St., separate
from MIT’s GigE connection.
minutes26.doc 5/2/2003
1
Network Connections
− Regarding the network diagram (attached), Pat pointed out that H6A in the diagram is there
for future reference when 10 Gbit is available; also shows the future USNO connection.
− The attached network diagram shows only Abilene and DREN as external networks when
there are many other external connections. These are placeholders for other potential e-VLBI
connections (Hawaii, for example)
− Pat asked why USNO is not a DREN site. Alan answered that USNO is currently not
connected to DREN and the bureaucratic obstacles to a DREN connection to USNO appear to
be formidable.
− Pat requested that Alan send copies of the network diagrams in their native format that other
people can modify and mark up.
− Tom Lehman and Jerry Sobieski are proposing to NSF the development of an advanced
infrastructure which, if successful, would support advanced services include some
connections at 10Gbps and would be very useful for e-VLBI.
Network Testing
Pat suggested that regular testing of connectivity over paths of the
Haystack/Bossnet/ISI/MAX/GSFC/GGAO network would help to quickly identify any network
changes or problems so that immediate remedial actions can be taken. Andy Drecker(sp?) at
GSFC has put together a script to do testing (connectivity and throughput) for 30 seconds of
every hour and then displays a time history of the results. Everyone agreed this is an excellent
idea; only problem is that Haystack must schedule usage of Bossnet. Pat will distribute more
detailed information.
Hawaii Connection
− Equipment is now in place for the connection to Hawaii. Kevin has done some testing. From
Hawaii to Haystack, traffic is routed across the U.S. on Abilene; however, from Haystack to
Hawaii, traffic is routed onto DREN (lower bandwidth) at Eckington and is filtered when
reaches the U. of Hawaii router. The routing onto DREN is due to Abilene usage policy that
says that traffic with a federal destination is routed onto a federal network (DREN) at the
earliest possible point. This may be OK since the high-bandwidth path is from Hawaii to
Haystack; Kevin will do further testing. Kevin will contact the relevant person at U. of
Hawaii to request modification of the firewall to let the Haystack-to-Hawaii packets through.
− Alan will include a connectivity diagram showing the connections to Hawaii and the potential
connection to USNO.
Japanese Connection
Kevin reported that quite a bit of e-VLBI data has been transferred to/from Japan. Connection is
slow due to small frame sizes. Kevin is working with Japanese to tune, but Japanese are using
FreeBSD which is causing Kevin some problems. After tuning, rates should increase substantially.
Next telecon
Next telecon is scheduled for Mon, 19 May 2003 at 2 pm EDT.
minutes26.doc 5/2/2003
2
xc:
Steve Bernstein, LL
Jim Calvin, LL
Rick Larkin, LL
Lorraine Prior, LL
Peter Schulz, LL
Leslie Weiner, LL
Herbert Durbeck, GSFC
Bill Fink, GSFC
Lee Foster, GSFC
Pat Gary, GSFC
Chuck Kodak, GSFC
Kevin Kranacs, GSFC
Paul Lang, GSFC
Aruna Muppalla, GSFC
Bill Wildes, GSFC
Dan Magorian, UMCP
Tom Lehman, ISI-E
Jerry Sobieski, MAX
Richard Crowley, Haystack
Kevin Dudevoir, Haystack
Hans Hinteregger, Haystack
David Lapsley, Haystack
Arthur Niell, Haystack
Joe Salah, Haystack
minutes26.doc 5/2/2003
3
Req’d during data acq
A0
Mk5 Cntl
Cmptr
A1
Mark 5
Westford Antenna
Millstone RPE Bldg
A2
SX
1
Summit
1i
GigE
SX
Westford
LAN
Mark 5
Dedicated no scheduling
A2A
Alpine
A4
3804
Haystack Correlator
Internet
B1
Mark 5
(correlator)
Haystack
LAN
B1A
Corr
Cntl
Cmptr
SX
28-1A
B2
GigE
B5
14
SX 28-1A
RJ-45
13
2
B4A
1
LL
C2
Dedicated no scheduling
Mark 5 B2A
(correlator)
Mark 5
B3A (correlator)
C3
16
Summit
WDM
GigE
5i
15
(Shared with LL on
scheduled basis)
Cisco
1500
B6
RJ-45
B11
B3
Test
WS
Req’d during data processing
B4
Congress St
Boston
(~50 km)
Amp
D3
WDM
D2
Lincoln Lab
Schedule to be
coordinated with LL
Cisco
1500
3l (2 GigE + 1 OC-48)
Dell Poweredge 2500
(’evlibhay’)
GlowNet
GlowNet
D1
Bossnet
Scheduling on
Bossnet calendar
Shared with MIT traffic
E6
(~100 km)
GigE
E3
E2
GigE
E1
E5A
GigE
8
A3
A1A
Schedule to be
coordinated with LL
C1
E4A
Test
WS
Juniper
M20
Alpine
3804
E7
E4
GigE
Test
WS
GigE
E5
MIT
Campus
OC-48
WDM
1310nm
F1
E8
Amp
Amp
F2
E9
Other users (no control)
To be upgraded to OC-48
(’superglide’)
(’evlbill’)
From ISI-E
Dell Poweredge 500SC
(provided by Haystack)
Figure 1: e-VLBI Path - Haystack to ISI-E
evlbi011.cdr
27 Mar 03
ISI-E
Test
WS
Scheduling on
Bossnet calendar
MAX@ISI-E
G6
G7
Test
WS
Summit
5i
GE
(’kame’)
G13
GigE
G1
G8
G2
OC-48
WDM
G6B
G7B
G5
(’omega’)
Bossnet
GE
G6C
GigE
GigE
OC-48
G16
Abilene
G14
MAX@Eckington
H7
H7C
Juniper
OC-48
M160
Juniper
M160
OC-48
H7B
GigE
H8
GigE
H9
Primary e-VLBI path
H7C
DREN
LX (~14km)
Need details
H2
GigE
G11
G10
H3A
H4
J3
Test
WS?
OC-48
J2
H3
No scheduling;
sufficient capacity
for e-VLBI
GigE
Juniper
M160
Borrowed OC-48
interface - may not
be able to keep
H6
OC-48
GigE
H6B
MAX@UMCP
H7A
H1
G12
GigE
Test
WS?
H5
Frame relay encapsulation
No jumbo frames
Abilene
Switch
Backup plan
Juniper
M40
G15
GigE
Nortel
8600
Summit
5i
G4
MAX@GWU
Other users ( no control)
Cisco
4912
Switch
J5
J4
GigE
WDM
GigE
on loan from GSFC
Summit
5i
H10
GigE
H11
LuxN
AMP
LuxN
H6C
2 GigE l’s
J1
H6A
USNO?
J6
GSFC/Bldg 28
K4
K1
WDM
GGAO/Bldg 201
GigE
K2
GigE LX (~7.25km)
1310nm K7
Summit
5i
K3
K5A
K5
G4 Mac with
Yellowdog Linux
(’clifford’)
Test
WS
Test
WS
K6
K6A
K5B
Cisco
12016
K6B
GGAO Antenna Trailer
GigE Summit L3
GigE
L1
5i
L5
G4 Mac
(’pluto’)
Windows PC
(’xly’)
RJ-45
Test
WS
Internet
L4
L2
Dedicated - no
scheduling necessary
(~500m)
RJ-45
Mark 5
NASA
LAN
L3A
RJ-45
L4A
Mark 5
L6
Mark 5
Cntl
Cmptr
L5
Req’d during data acq
evlbi012.cdr
Figure 2: e-VLBI Path - ISI-E to GSFC/GGAO
27 Mar 03
Site
A
FO cable
12 pairs?
TM
ATM
UH
Router
ATM
OC3
155 Mb/s
UofH Manoa Keller Hall
STM-1
155
Mb/s
HIC
Router
ATM
HIC
FO
3xDS3 135 Mb/s
Microwave Link
Oahu
PMRF
Barking
Sands
DREN
OC3
155 Mb/s
UMd
OC3
155
Mb/s
DREN
Pacific Wave
155 Mb/s
GWU
DCGW
Fiber
Ring
DARPA
2.5
Gb/s
DCNE
Qwest
BOSSNET/
GLOWNET
OC48
OC48
2.5 Gb/s
OC48
Abilene
MM
Link
GigE
TE?
CLPK
MAX
Pacific NW
Giga pop
Abilene
Router
MM
Link
3xDS3 135 Mb/s
Comm
Mux,
ATM SW
HIC
Router
ATM
Westin Bldg
DREN
ATM
FO
SPAWAR Bldg 992
Seattle
OC3
Comm
ATM
Gig E
TE ?
Gb/s @ 80 GHz
Comm
ATM
~8 km
Experimental Link
Antenna
NASA
Makaha Ridge
Terminal Equipment (TE)
Requirements?
GigE?
Kokee Park
~2.4 km
ARLG
ISI-E
PROPOSED DARK FIBER LEASE
OC48 2.5 Gb/s
DC Area
USNO
Haystack
Obs
VLBI
Correlators