Strategic Applications to Drive Strategic
Technologies for the 21st Century
• Keynote Talk at the RCI Annual Member
Management Executive Conference
• Arlington, Virginia October 13, 1998.
National Computational Science Alliance
The Emerging Concept of a National Scale
Information Power Grid
Imagine a national computing and information
infrastructure that allowed everyone to access the
information resources of the nation in much the
same way that one accesses electrical power today -an “Information Power Grid” -- NASA
http://science.nas.nasa.gov/Groups/Tools/IPG
National Computational Science Alliance
The Grid Links People with
Distributed Resources on a National Scale
http://science.nas.nasa.gov/Groups/Tools/IPG
National Computational Science Alliance
The Grid - “Dependable, Consistent,
Pervasive Access to [High-end] Resources”
• Dependable:
– Can Provide Performance and
Functionality Guarantees
• Consistent:
– Uniform Interfaces to a Wide
Variety of Resources
• Pervasive:
– Ability to “Plug In” From Anywhere
Source: Ian Foster, ANL
National Computational Science Alliance
The Grid:
Blueprint for a New Computing Infrastructure
Ian Foster, Carl Kesselman (Eds), Morgan Kaufmann, 1999
• Available July 1998;
ISBN 1-55860-475-8
• 22 chapters by expert authors
including:
–
–
–
–
–
–
–
–
–
–
–
–
–
–
Andrew Chien,
Jack Dongarra,
Tom DeFanti,
Andrew Grimshaw,
Roch Guerin,
Ken Kennedy,
Paul Messina,
Cliff Neuman,
“A source book for the history
Jon Postel,
of the future” -- Vint Cerf
Larry Smarr,
Rick Stevens,
Charlie Catlett
John Toole
and many others
http://www.mkp.com/grids
National Computational Science Alliance
The National Computational Science Alliance
www.ncsa.uiuc.edu
National Computational Science Alliance
The National Partnership for
Advanced Computational Infrastructure
www.npaci.edu
National Computational Science Alliance
The National Science Foundation’s vBNS Topology October 1998
Source: R. Patterson, R. Butler, NCSA-NLANRb
National Computational Science Alliance
Assembling the Links in the Grid
with NSF’s vBNS Connections Program
NCSA runs NLANR Distributed Applications Support Team for vBNS
27 Alliance sites running...
StarTAP
NCSA
…19 more in progress.
vBNS Backbone Node
vBNS Connected Alliance Site
Indiana University
Abilene NOC
1999: Expansion via Internet2 -- Abilene
vBNS & Abilene at 2.4 Gbit/s
vBNS Alliance Site Scheduled for Connection
Source: Charlie Catlett, Randy Butler, NCSA Grid Team
National Computational Science Alliance
Qwest Nationwide Network Backbone for Internet2 Abilene - More Links
Qwest Partnering with Cisco and Nortel
http://www.qwest.net/network/Mainmaps.html
Source: Randy Butler, NCSA
National Computational Science Alliance
Grid Enabled
Workshop and Training Facilities
Being Deployed Across the Alliance
Jason Leigh and Tom DeFanti, EVL; Rick Stevens, ANL
National Computational Science Alliance
New Alliance Center for Collaboration,
Education, Science, and Software (ACCESS)
•
•
•
•
•
•
7000 Square Feet in the Wash
D.C. Metropolitan Area Construction Completed Sept ‘98
Remote and Local Access to
Alliance Technologies, Leaders,
Researchers, and Partners
Collaborative Demonstrations,
Training, Digital Video
Teleconferencing, and Visitors
Immersadesk, Power Wall,
Projected Advanced High
Bandwidth Applications
Initiated Using State of Illinois
Cost Sharing
FY99 -- Extend Access Centers
Throughout the Alliance
National Computational Science Alliance
Supercomputers, Networks, and Virtual Reality -From the Heroic to the Routine
•
•
•
•
Virtual Director in CAVE for Choreography of Data
1000 Hour SDSC Supercomputer Run to Generate Data
Tens of Thousands of Hours of NCSA SGI Time to Render Data
Cross-Country Transfer to IMAX Film of Massive Amounts of Data
Colliding Galaxies (Smithsonian IMAX)-Donna Cox, Bob Patterson,
NCSA-From “Cosmic Voyage”-Nominated for Academy Award 1997
National Computational Science Alliance
The Grid Links Remote Sensors With
Supercomputers, Controls, & Digital Archives
Starburst Galaxy M82
• Creating Remote Super Telescopes
– BIMA and NRAO
– Collaborative Web Interface
– Real Time Control and Steering
Alliance Scientific Instrument Applications Team
National Computational Science Alliance
Using the Grid to Create
Super-Biomedical Instruments
www.npaci.edu/Research/index.html
NPACI Neurosciences Research Thrust
National Computational Science Alliance
The NCSA Information Workbench An Architecture for Web-Based Computing
User Input
User Web Browser
Output to User
User
Instructions
and queries
Workbench
Application
Programs Instructions
(May have varying
interfaces and be
written in different
languages)
Results
to User
Server
Information
Queries Sources
(May be of
Format Translator,
varying formats)
Query Engine and
Program Driver
Results
Information
NCSA Computational Biology Group
National Computational Science Alliance
Using a Web Browser
to Run Programs and Analyze Data Worldwide
Genomes
Populations
Structure &
& Evolution
Function
Gene
Pathways &
Ecosystems
Products
Physiology
NCSA Biology Workbench
Has Over 6,000 Users From Over 20 Countries
National Computational Science Alliance
Alliance Chemical Engineering Team
Developing the Chemical Engineer’s Workbench
Couple Supercomputer Models
For All These Scales Together
O(km)
O(m)
O(cm)
O(nm)
Access From a Web Browser!
National Computational Science Alliance
Using the Grid to Optimize
Chemical Plant Operations
Measurements and
Experimental Design
Process
Control
Signals
Grid Coupling:
Sensors
Networks
Data
HPC Models
Controls
Plant-wide Control
Alliance Chemical Engineering Applications Team
Process
Data
Parameter
Estimation
Process
Model
National Computational Science Alliance
Goal-Create Collaborative Interface
to Link Multiple Investigators With the Grid
Status of
Simulation
Interactive
Discussion
Detailed
Visualization
Current
parameters
in solution
Reactor
Simulation
Ken Bishop, U Kansas Using NCSA Habanero
National Computational Science Alliance
The Killer Application for the Grid Collaborative Tele-Immersion
CAVE
ImmersaDesk
Different Physical Implementations of the
Alliance CAVE Software Libraries
Image courtesy: Electronic Visualization Laboratory, UIUC
National Computational Science Alliance
Using the vBNS to Link
Alliance Virtual Reality Devices
Image by Robert Patterson, NCSA
National Computational Science Alliance
Environmental Hydrology Collaboration:
From CAVE to Desktop
Using Java and Java3d to Bring Collaboration and CAVE Capabilities
To the Desktop
Java Port of Cave5D, Enhanced With Java3D, Wand Control and
Flock-of-birds Position Tracking Using NT
Pietrowicz/NCSA-LES; Hibbard/Wisconsin
National Computational Science Alliance
A Working Model-Caterpillar’s Collaborative
Virtual Prototyping Environment
Real Time Linked VR and Audio-Video
Between NCSA, Peoria, Houston, and Germany
National Computational Science Alliance
Goal-Global Enterprise Management
Designer
ATM/IP Network
Customer
Supplier
Manufacturing
Facility
National Computational Science Alliance
Bringing the Grid to the Virtual Battlefield
NCSA, Beckman Institute, Army Research Lab
National Computational Science Alliance
The Continuing Exponential
Agent of Change
1985
1998
SGI Origin
(128 Processors)
100x
10,000x
Cray X-MP
(2-processors)
100x
Parallelism
1x
100x
Vectors
IBM PC/AT
(1-processor)
100x
Compaq Desktop (2-processors)
Pentium II 333 Mhz
National Computational Science Alliance
Development of Computational Methods in Chemistry
Awarded the 1998 Nobel Prize for Chemistry
• Walter Kohn
– University of California at Santa Barbara, USA
• John A. Pople
– Northwestern University, Evanston, Illinois, USA
• “to Walter Kohn for his development of the
density-functional theory and to John Pople for
his development of computational methods in
quantum chemistry”
Freon and Ozone
www.nobel.se/announcement-98/chemistry98.html
National Computational Science Alliance
1985
1993
1995
1997
1999
The Evolution of Shared Memory
Parallel & Distributed Computing
Vector SMPs
to
Microprocessor SMPs
to
Clustered Microprocessor SMPs
to
Microprocessor DSMs
to
Clustered Microprocessor DSMs
Alliance LES
National Computational Science Alliance
Clustered Shared Memory Computers are
Today’s High End
NCSA has 6 x 128 Origin Processors
ASC has 4 x 128
ARL has 3 x 128
CEWES has 1 x 128
NAVO has 1 x 128
Los Alamos ASCI Blue Will Have
48 x 128!
Livermore ASCI Blue has 1536x4 IBM SP
National Computational Science Alliance
Evolution of a Red Giant with White Dwarf CoreHow High Speed Networks Enhance Analysis
128-processor
SGI Origin
Surface
View
Run for One
Week
Generated
Terabytes of
Data
Data Moved From NCSA over vBNS to U MinnesotaVisualization at SC97 While Week-Long Simulation Runs at NCSA
vBNS Gives 500-Fold Thruput Increase Over Commercial Internet!
Porter, Anderson, Habermann, Ruwart, & Woodward , LCSE,Nov. 1997
www.lcse.umn.edu/RedGiant/
National Computational Science Alliance
Storm and Mesoscale Ensemble Experiment 1998 Center for Analysis and Prediction of Storms
Kelvin Droegemeier, Univ. of Oklahoma,
Director, CAPS
Run in Morning Compare with Reality
in the Afternoon!
CAPS Collaborators:
NCAR
NSSL
AFWA
NCEP
Ran on PSC T3D-512
http://origin.caps.ou.edu/~samex/arps/19980524/12Z_nc9/13h/refl-2km.gif
National Computational Science Alliance
Predicting Spring Storms in 1999 and Beyond -A Grid Based Computational Science Experiment
• NCSA and Regional Models Running Concurrently
• Local NEXRAD Doppler Radars to Initialize Models
Storm and Mesoscale Ensemble Experiment
(SAMEX)—1999 and Beyond
• Models Accessed Over Web
20-30 km Resolution Ensemble Domain
NCSA
Requirement:
5 Hr./day on
Origin 128
Lasting Two
Months
Spring ‘99
Pacific
Northwest
Northeast
Northern Great Plains
Great Lakes
California
Coast
Inter-Mountain
Central and
Southern
Great Plains
Southeast
Florida
Coast
ns f
Kelvin Droegemeier, Director CAPS, Univ. Oklahoma
National Computational Science Alliance
Globus Ubiquitous Supercomputing Testbed
(GUSTO)
• Alliance Middleware for the Grid
• GII Next Generation Winner
• SF Express-- Synthetic Theatre of War Simulation
– Multi-site-DARPA, DOE, DOD Mod and NSF PACI
– Largest Distributed Interactive Simulation Ever Performed
– 100,000 vehicle simulation
– Tanks, Fighting Vehicles, Armored Personnel Carriers, Trucks
– 1386 processors on 13 computers at 9 sites
National Computational Science Alliance
Quantum Simulations Using WebFlow a High Level Visual Interface for Globus
Now Co-Funded by
Sun Microsystems
Alliance
• Distributed Computing ET Team
• Nanomaterials AT Team
E. Akarsu, G. Fox, W. Furmanski, T.Haupt (NPAC, Syracuse U), L. Mitas (NCSA)
National Computational Science Alliance
Harnessing the Unused Cycles of
Networks of Workstations
Alliance Nanotechnologies Team
Used Univ. of Wisconsin Condor Cluster Burned 1 CPU-Year in Two Weeks!
Condor Cycles
University of Kansas is Installing Condor
National Computational Science Alliance
Workstations Shipped (Millions)
NT Workstation Shipments
Rapidly Surpassing UNIX
1.4
1.2
UNIX
1
NT
0.8
0.6
0.4
0.2
0
1995
1996
1997
Source: IDC, Wall Street Journal, 3/6/98
National Computational Science Alliance
NCSA / Allstate
NT Cluster Data Refinery
1000 Gigabytes of Allstate Claims Data
Parallel
Compute
Cluster
Compaq
NT
Server
Visualization
Stations
Terabyte
“Smart Bucket”
Compaq
NT
Server
External
Networks
Data Mine on Cleaned Gigabyte Samples
Source: Allstate & Tilt Thompkins, NCSA
National Computational Science Alliance
Creating Scalable NT/Intel Servers
“Supercomputer performance at mail-order prices”-- Jim Gray, Microsoft
• Andrew Chien, CS UIUC-->UCSD
• Rob Pennington, NCSA
• Myrinet Network, HPVM, Fast Messages
• Microsoft NT OS, MPI API
192 Hewlett Packard
300 MHz
64 Compaq 333 MHz
National Computational Science Alliance
Solving 2D Navier-Stokes Kernel Performance of Scalable Systems
Preconditioned Conjugate Gradient Method With
Multi-level Additive Schwarz Richardson Pre-conditioner
(2D 1024x1024)
7
Origin-DSM
Origin-MPI
6
NT-MPI
Gigaflops
5
Various
Applications
Sustaining
7 GF on
128 Processors
NT Supercluster
SP2-MPI
T3E-MPI
4
SPP2000-DSM
3
2
1
60
50
40
30
20
10
0
0
Processors
Danesh Tafti, Rob Pennington, NCSA; Andrew Chien (UIUC, UCSD)
National Computational Science Alliance
The Road to Intel’s Merced
The Convergence of Scientific and Commercial Computing
IA-64 Co-Developed by Intel and Hewlett-Packard
http://developer.intel.com/solutions/archive/issue5/focus.htm#FOUR
National Computational Science Alliance