OptIPuter Overview
Third All Hands Meeting
OptIPuter Project
San Diego Supercomputer Center
University of California, San Diego
January 26 , 2005
Dr. Larry Smarr
Director, California Institute for Telecommunications and
Information Technologies
Harry E. Gruber Professor,
Dept. of Computer Science and Engineering
Jacobs School of Engineering, UCSD
AHM Overview
What We Need to Focus on Completing
• Year 3: MILESTONE: By Year 3, the goal is to have operational
OptIPuter testbeds on the campus, metro, regional, national
and international levels, connecting OptIPuter partner sites in
Southern California to Chicago by use of either TeraGrid or
National Light Rail and Pacific Light Rail. A full set of system
software, visualization, data management and collaboration
systems will be in place. Enhanced transport protocols to
improve end-to-end performance will be demonstrated.
Extensive monitoring and tuning of OptIPuter applications and
middleware subcomponents will provide feedback for ongoing
research efforts.
• Year 4: e-Science advancements facilitated by the OptIPuter
testbed will be demonstrated.
AHM Overview
What Are the Technical Challenges
We Need to Address This Year?
•
Multiple Latency Application and Networking Persistent Testbeds
–
–
–
–
Need DVC Integrated with Signaling, Management, and Transport Protocols
Stabilize for Apps to Use
Extensive Monitoring, Analysis, and Optimization Needs to Occur
Identify and Support Four Different Scale Testbeds for Next 2.5 Years
–
–
–
–
•
DVC
–
•
Campus UCSD
Metro Chicago
National CAVEwave UCSD to UW to UIC
International UCSD to Starlight to Amsterdam
Integrate GTP, LambdaStream, UDT into DVC
Applications Using WAN OptIPuter
– Coupling Application Kernels to DVCs
– Demonstrate on Four Testbeds Above
•
Collaboration Rooms
– Regular Use of CAVEwave and SoCal LambdaGrid
– Partner with Social Science Researchers in Collaborative Works
AHM Overview
UCSD Campus LambdaStore
Architecture
SIO Ocean Supercomputer
IBM Storage Cluster
Extreme switch with
2 ten gigabit uplinks
AHM Overview
Streaming
Microscope
OptIPuter National Testbed
10GE CAVEwave Rides the National LambdaRail
EVL
Next Step: Coupling
NASA Centers
to NSF OptIPuter Testbed
AHM Overview
Source: Tom DeFanti, OptIPuter co-PI
What Are the Technical Challenges
We Need to Address This Year?
•
Streaming Data Flows
– LambdaStream
– CineGrid
– HDTV
•
Control of Parallel Lambdas
–
–
–
–
•
DWDM Coupled to Parallel Cluster I/O
For Multiple Data Flows (HD, Control, Vis)
For High Bandwidth to Match Clusters
“Terabits to the Desktop” and Cluster/ WAN bandwidth balance as Goal
Security
– Evaluate Globus GSI for LambdaGrids
– Collective Trust Problems
•
Publishing
– Define High Level Computer Science Research Topics
– Target Publications in Top Journals
– Presentations at Key Conferences
AHM Overview
Today’s Lecture--Uncompressed HDTV at 1.5 Gpbs
Live From Seattle to Osaka
Seattle
Chicago
Osaka
Japan: NiCT/ JGN II, NiCT/APAN, NTT Group, KDDI, WIDE Project
USA: University of California San Diego/Calit2, University of Washington/Pacific
Northwest Gigapop, PacificWave, ResearchChannel, Pacific Interface, Inc., StarLight
(Argonne National Laboratory, Northwestern University, University of Illinois at Chicago),
Indiana University, Intel
Circuits: JGN II, WIDE, KDDI, NTT Group, IEEAF, NLR (National Lambda Rail)
AHM Overview Enabled by International Human Networks
OptIPuter User Interface
Scaling to 100 MegaPixels!
55-Panel Display
100 Megapixels
30 x 10GE interfaces
1/3 Tera bit/sec
Driven by 30 Node
Cluster of 64 bit
Dual Opterons
60 TB Disk
Linked to OptIPuter
Working with NASA
Teams to Unify
Software
AHM Overview
Source: Jason Leigh, Tom DeFanti, EVL@UIC
OptIPuter Co-PIs
Enhancements and Extensions
of OptIPuter Project
•
Extension to Include Web and Grid Services
•
Switching of Lambdas
•
Teraflow Testbed
•
•
•
•
RR at UIC
Sloan with OptIPuter
U Amsterdam
Scalable Visualization Nodes
•
Lambda Connectivity
•
International Partners
•
– LOOKING ITR Funded UWash and UCSD
– Quartzite MRI Funded at UCSD
– Bob Grossman
– LambdaVision MRI Funded at UIC
– Macintosh G5 Cluster and 30” Display Tiled Wall at SIO
– CAVEwave Funded by UIC
– iGRID 2005
– LOOKING (Mexico and Canada)
– NCMIR Telescience and BIRN (Japan, Korea, UK)
– SARA New Partner
New Applications
– Bringing JPL, Ames, Goddard onto OptIPuter and NLR
– fMRI NIH Grant Funded at UCI
– Stereo HD to a Varrier Wall
AHM Overview
OptIPuter Interactive Browsing of Remote
Earth Sciences Images on Scalable Displays
Enables Scientists To
Perform Coordinated
Studies Of Multiple
Remote-Sensing Or
Simulation Datasets
Source: Milt Halem & Randall Jones, NASA GSFC
& Maxine Brown, UIC EVL
Eric Sokolowsky
Earth Science Data Sets Created by GSFC's
Scientific Visualization Studio were Retrieved
Across the NLR in Real Time from OptIPuter
Servers in Chicago & San Diego and From
GSFC Servers in McLean, VA, then Displayed
at SC2004 in Pittsburgh
AHM Overview
http://esdcd.gsfc.nasa.gov/LNetphoto3.html
Announcing…
Call for Applications Using
the GLIF SuperNetwork
iGrid
2oo5
THE GLOBAL LAMBDA INTEGRATED FACILITY
www.startap.net/igrid2005/
September 26-30, 2005
University of California, San Diego
California Institute for Telecommunications and Information Technology
AHM Overview
Maxine Brown, Tom DeFanti, Co-Organizers