Coupling the Leading Edge Site
with the Alliance Partners
• Talk given to Alliance ‘98 at the University of
Illinois at Urbana-Champaign
• April 28, 1998
National Computational Science Alliance
Welcome to
Hosted by the
National Center for Supercomputing Applications
University of Illinois at Urbana-Champaign
Email Your EC Questions to A98-quest.ncsa.uiuc.edu
National Computational Science Alliance
Coupling the Leading-Edge Site
with the Alliance Partners
Alliance map and video by Robert Patterson, NCSA
National Computational Science Alliance
The In-Depth Archive of the
Alliance Leading Edge Site
www.ncsa.uiuc.edu
National Computational Science Alliance
Keep Up-To-Date with News of the Alliance
alliance.ncsa.uiuc.edu
access.ncsa.uiuc.edu
National Computational Science Alliance
The New Alliance Community
Be Sure to Check Out the Poster at A98
National Computational Science Alliance
Program Wide DoD MSRC Webmasters
Meeting at NCSA
Syracuse
CEWES
ARL
ASC
NAVO
NCSA
What It Takes to Create Online Shared
Information / Collaboration Environments
Dod MSRC and PET Webmasters Meeting
NCSA, Feb. 3-5, 1998
National Computational Science Alliance
Alliance Emerging Technologies Course
on Streaming Video
• After A’98, NCSA
will have 20 courses
• Alliance Goal of
100 by end of 1998
Alliance’98
Talks Will Be
Webcast and
Archived
http://www.ncsa.uiuc.edu/edu/course98/lecturers/week/
National Computational Science Alliance
Alliance Researchers Using a Digital Video
Computational Infrastructure
CAVE Virtual Director
Habanero
Teams
Internet,
vBNS
Desktop Video
Teleconferencing
Individual Desktops
Create Digital Video Animation
Concurrently with Supercomputing
Digital Video
Server
= Digital Video Streams
National Computational Science Alliance
Distance Education Using JAVA Plug-ins to Web Browsers
Source: Geoffrey Fox, NPAC/Syracuse; CEWES
National Computational Science Alliance
NCSA Parallel Computing Training -November 1997
www.ncsa.uiuc.edu/Training
National Computational Science Alliance
The Growth Rate of the National Capacity
is Slowing Down again
1,000,000,000
Total NU
Normalized CPU Hours
70% Annual Growth
This Year
100,000,000
10,000,000
Let’s Blow This Up!
1,000,000
100,000
2002
2000
1998
1996
1994
1992
1990
1988
1986
10,000
Fiscal Year
Source: Quantum Research; Lex Lane, NCSA
National Computational Science Alliance
Major Gap Developing in National Usage
at NSF Supercomputer Centers
Projection
70% Annual Growth
Rate is the Historical
Rate of National
Usage Growth.
It Also Slightly
Greater Than the
Rate of Moore’s Law,
So Lesser Growth
Means Desktops Gain
on Supers
National Computational Science Alliance
Accelerated Strategic Computing Initiative is
Coupling DOE DP Labs to Universities
• Access to ASCI Leading Edge Supercomputers
• Academic Strategic Alliances Program
• Data and Visualization Corridors
http://www.llnl.gov/asci-alliances/centers.html
National Computational Science Alliance
DOE Strategic Simulation Initiative
•
•
•
•
•
•
•
•
Major New FY00 Computational Initiative for DOE ER
Large-scale Problems in Energy and the Environment
Initial Targets Are Climate Simulation and Combustion
Major Investment in Applications, Computer Science &
Applied Mathematics, and Computational Facilities
Pursued Jointly With Universities, Labs and Industry
Will Leverage ASCI Investments
Will Field Machines in the 40-50TF Range in 2003
Opportunity for Synergy with NSF PACI
Courtesy of Rick Stevens, Argonne
National Computational Science Alliance
The Emerging Multi-Agency Effort to Create a
Persistent National Technology Grid
• NSF Working Closely with NPACI & Alliance
– See Reagan Moore Talk at A’98
– NPACI Representatives at A’98 All Hands
• KDI Proposals Will Require PACI Infrastructure
• DoE Discussing with NSF
– How to Get More Cycles
– PACI ET and AT Teams Linking to ASCI, SSI
• NASA MOU with NSF on Computational Grids
• DoD Mod. PET Innovating Infrastructure
• NIH Potentially Critical Partner
National Computational Science Alliance
NCSA’s Forest of Origins
National Computational Science Alliance
Cosmology, Environ. Hydro., & Nanomaterials
Applications Using Full 128-Processors of Origin
Users, NCSA, SGI, and Alliance Parallel Team Working
to Make Better Scaling Routine
120
QMC
Martrix-Vector
ZEUS-MP Blast
Speedup
100
RIEMANN-HPF
Laplace-DSM
ZEUS-MP Radn.
Perfect Scaling
80
60
40
20
120
100
80
60
40
20
0
0
Processors
Source: Mitas, Hayes, Tafti, Saied, Balsara, NCSA
National Computational Science Alliance
JP Morgan Hero Calculation
• HPC Strategic Business Analysis
• Calculations Used 128-Processor SGI Origin
– Two Week Period in January 1998
– NCSA and SGI Doubled Memory in a Week
• Extended JPM's Risk Management Capabilities
• Hundreds of Market Scenarios Simulated
• NCSA, Strategic Vendor, Industrial Partner
– Existing Relationships Facilitated Quick Startup
– Win-Win-Win Result
Andrew Abrahams, Jeff Saltz, JP Morgan
National Computational Science Alliance
Proposed NCSA SGI/Cray Origin Array FY99
Processors
Origin Array
6x128
4x64
Subject to NSF Approval of Funds
National Computational Science Alliance
Alliance PACS Origin2000 Repository
Kadin Tseng, BU, Gary Jensen, NCSA, Chuck Swanson, SGI
John Connolly, U Kentucky Developing Repository for HP Exemplar
http://scv.bu.edu/SCV/Origin2000/
National Computational Science Alliance
PACS Communities
• Computational Resources and Services
– AAB, NRAC capacity for small to medium users
• Communities
– EPSCoR
– CIC
– SURA
• Technology Deployment
– Sub GRID Testbeds (Condor)
– G-Force Linkage
• Training
National Computational Science Alliance
NCSA & Alliance Parallel Computing Team
Supports Portable Computing Standards
• MPI
– Interface to the NT Supercluster
• HPF
– CRPC Advanced Features (See Kennedy Talk)
– Chien’s HPVM Supports Both HPF and MPI
• OpenMP
– NCSA Beta Site for SGI Origin Compiler
– Evaluating Kuck & Assocs. Origin Compiler
– Tutorial at Alliance’98
• Hybrids
– OpenMP and MPI
– Dynamic Load Balancing and Portability!
National Computational Science Alliance
Workstations Shipped (Millions)
NT Workstation Shipments
Rapidly Surpassing UNIX
1.4
1.2
UNIX
1
NT
0.8
0.6
0.4
0.2
0
1995
1996
Source: IDC, Wall Street Journal, 3/6/98
1997
National Computational Science Alliance
The Road to Merced
National Computational Science Alliance
First Scientific Code Using Alliance
NT / Intel HP-Compaq Cluster
“Supercomputer performance at mail-order prices”-- Jim Gray, Microsoft
access.ncsa.uiuc.edu/CoverStories/SuperCluster/super.html
300
Zeus-MP Hydro Code Running Under MPI
Speedup
250
Winter ‘9
200
150
100
Summer ‘98
Spring ‘98
50
Be Sure to Check Out the Demo at A98
500
450
400
Rob Pennington, NCSA
Processors
LCA, UIUC, Alliance Cosmology Team
Andrew Chien, UIUC Alliance Parallel Team
350
300
250
200
150
100
50
0
0
National Computational Science Alliance
NCSA Symbio - A Distributed Object Framework
Bringing Scalable Computing to NT Desktops
• Parallel Computing on NT Clusters
– Briand Sanderson, NCSA
– Microsoft Co-Funds Development
• Features
– Based on Microsoft DCOM
– Batch or Interactive Modes
– Application Development Wizards
• Current Status & Future Plans
– Symbio Developer Preview 2 Released
– Princeton University Testbed
http://access.ncsa.uiuc.edu/Features/Symbio/Symbio.html
National Computational Science Alliance
Java Grande: Java for HPC
• Research Java Extensions and Frameworks for
–
–
–
–
High Performance GRID Computation
CS&E Distributed Modeling and Simulation
Data Intensive Computing
Computational and Communications-Intensive
Applications
– Commercial Computing
– Scientific Research Applications
– Alliance Leadership
– Fox (NPAC/Syracuse), Gannon (Indiana), Ceperley (NCSA)
– Sun funding for Syracuse / Indiana / NCSA project
• Java Grande Forum is Community Standards Effort
National Computational Science Alliance
FY98 NCSA Enhanced Mass Storage Testbed for Alliance Data Team Performance Analysis
• Working to Increase Reliability to 99+%
• New Machine - HP SPP-2000 Exemplar
– More Memory and I/O Channels
• New Software - HP Unitree 3.1
– Uses Parallel I/O Internally
• New EMC RAID and Data Sharing
– 3 TB Rotating Storage
• New Library - STK Powderhorn
– Holds 6000 Cartridges
• New Tape Drives - Still to Come
• Fibre Channel Testbed
National Computational Science Alliance
The Coming Integration of
Technical and Commercial Computing
• The Emergence of
High Performance Commercial Computing
– Computational Knowledge Management
– Focus on:
– Large Data Sets and Information Visualization
– AI Techniques for Data Mining
– Optimization and Decision Support
– Financial “Rocket Science”
• NT / UNIX Interoperability and Scalability
– HP and SGI UNIX DSMs
– Scalable Microsoft NT Clusters and NCSA Symbio
– Merced Processor in FY99-00
National Computational Science Alliance
Knowledge Discovery Applications
Marketing
 Target marketing
 Customer relationships
 Market basket analysis
 Cross selling
 Market segmentation
Strategic Analysis
 Forecasting
 Customer retention
 Improved underwriting
 Competitive analysis
 Fraud detection
Manufacturing
 Troubleshooting
 Problem prediction
 Reliability
 Quality control
Source: Michael Welge, Tilt Thompkins, NCSA
National Computational Science Alliance
Sears Pioneers Data Mining and
Information Visualization at NCSA
• 1998 VLDB Survey Program Grand Prize Winner
– Largest Database
– 4.7 Terabytes of Data
– 10 Terabyte Total Disk Space Capacity
– Storage Provided by EMC
Image Courtesy of Michael Welge, NCSA and Sears
National Computational Science Alliance
MREN - America’s First Operational GigaPOP
- Midwest Sites
Minnesota/LCSE
Wisconsin
Michigan Hub
MREN and STAR-TAP
U Michigan
Michigan State
Notre Dame
Ohio State Univ.
OC12 vBNS
NCSA Purdue
Indiana Hub
Indiana Univ
National Computational Science Alliance
FY98 Assembling the Links in the Grid
with NSF’s vBNS Connections Program
27 Alliance sites running...
StarTAP
NCSA
…16 more in progress.
vBNS Backbone Node
1999: Expansion via Abilene
vBNS & Abilene at 2.4 Gbit/s
vBNS Connected Alliance Site
vBNS Alliance Site Scheduled for Connection
Source: Charlie Catlett, Randy Butler, NCSA
National Computational Science Alliance
FY99 Qwest Nationwide Network Backbone for Internet2 Abilene - More Links
Qwest Partnering with Cisco and Nortel
http://www.qwest.net/network/Mainmaps.html
Source: Randy Butler, NCSA
National Computational Science Alliance
National Laboratory for Applied Network Research
Supports the Grid Links
Distributed Applications Support
(NCSA)
Engineering
(CMU)
Measurement/Analysis
(SDSC)
National Computational Science Alliance
Grid Task Force: G-Force
• Integration, Leverage, & Coordination of
Multiple Efforts
– PACS Advanced Computational Resources
– PACS/ET/AT Testbeds & Technology Deployment
– EOT Deployment and Coupling With PACS/ET/AT
• Grass Roots Alliance Technical Community
– Volunteer-driven, Inclusive/open
– Working Groups for Specific Deployment Projects
– Grid Working Document (GWD) Series
– Technical Advisory Committee
– Stevens, Catlett, Butler, Evard, Bresnehan
National Computational Science Alliance
Globus Ubiquitous Supercomputing Testbed
(GUSTO)
• Alliance Middleware for the Grid-Distributed Computing Team
• GII Next Generation Winner
• SF Express -- NPACI / Alliance DoD Mod. Demonstration
– Largest Distributed Interactive Simulation Ever Performed
• The Grid: Blueprint for a New Computing Infrastructure
– Edited by Ian Foster and Carl Kesselman, July 1998
• IEEE Symposium on High Performance Distributed Computing
– July 29-31, 1998 Chicago Illinois
• NASA IPG Most Recent Funding Addition
National Computational Science Alliance
Caterpillar’s Distributed
Virtual Prototyping Environment
Real Time Linked VR and Audio-Video
Between NCSA and Germany
& Using vBNS Between NCSA and Univ. of Houston
Using SGI Indy/Onyx and HP Workstations
Be Sure to Check Out the Demo at A98
National Computational Science Alliance
New Alliance Center for Collaboration,
Education, Science, and Software (ACCESS)
•
7000 square feet in the Wash D.C.
metropolitan area - Construction
completed Sept ‘98
 Remote and local access to
Alliance technologies, leaders,
researchers, and partners
 Collaborative Demonstrations,
Training, Digital Video
Teleconferencing, and Visitors
 ImmersaDesk, Power Wall,
projected advanced high
bandwidth applications
• Part of the network of Alliance
Distributed Computational
Centers throughout the Nation
Alliance map by Robert Patterson, NCSA
National Computational Science Alliance
NCSA CRUMBS Volumetric Analysis Tools From Drosophila Sperm to Molecular Hydrogen
Coupling NCSA with
Scientific Instruments and Nanomaterials Teams
Confocal Microscopy by
Tim Carr, UChicago
Path Integral Monte Carlo (1000 Origin CPU-Hours)
Burkhard Militzer, David Ceperley, NCSA
Visualize Volumes, Paths, Extract Curves as Splines
CRUMBS Software by Rachael Brady, video by Jeff Carpenter NCSA
National Computational Science Alliance
Linking CAVE to Vis5D = CAVE5D
Then Use Virtual Director to Analyze Simulations
Donna Cox, Robert Patterson, Stuart Levy,
NCSAVirtual Director Team
National Computational Science Alliance
Digital Video Created by Virtual Director
Supporting Analysis of Chesapeake Simulations
Alliance Environmental Hydrology Applications Team
Glen Wheless and Cathy Lascara,
Center for Coastal Physical Oceanography, Old Dominion University
Fish Larvae at Mouth of the Bay
15 Day Period
Salinity (Red-High, Yellow-Low)
Donna Cox, Robert Patterson, Stuart Levy,
NCSA Virtual Director Team
National Computational Science Alliance
Environmental Hydrology: Java3D + VisAD
NASA IPG is Adding Funding To Collaborative Java3D
Java 3D API HPC Application: VisAD
Environ. Hydrology Team, (Bill Hibbard, Wisconsin)
Steve Pietrowicz, NCSA Java Team
Standalone or CAVE-to-Laptop-Collaborative
Be Sure to Check Out the Demo at A98
National Computational Science Alliance
Alliance Chemical Engineering Team Multi-scale Computational Science
Be Sure to Check Out the Demo at A’98
National Computational Science Alliance
ARL Preventing Tanker Truck Roll Over HPC & Visualization Supporting Test and Evaluation
Participants:
ARL T&E Command
ARL MSRC-PET
NCSA Sci Viz
UMN AHPCRC
Clark Atlanta University
West Virginia University
Georgia Tech
68 Sensors Attached
to Truck to
Define Dynamics
HPC Simulation to Match
Sensor Readings
See ASC and CEWES talks, ARL Moderator on Weds 10 AM
National Computational Science Alliance
Radio Astronomy Habanero Prototype -Bringing Scientific Collaboration to the Grid
http://www.ncsa.uiuc.edu/SDG/Software/Habanero/
National Computational Science Alliance
EOT - Coupling Alliance / NPACI Efforts
into a National Program
• Building an Undergraduate Research Student
Community
– PACI Research Experiences for Undergraduates
– Undergrads Linked to PACI Computational Science Teams
• Customizing AT Technologies for Learning
– Chickscope
– RiverWeb
– Hayden, Adler Planetariums
• Designing the Digital Government of the 21st Century
– CTG, NCSA Hosting in DC Fall ‘98
– NSF Funded
National Computational Science Alliance
NCSA Federal Consortium
• Member Agencies:
• Funding IT Development
– Bureau of Census
– Security
– Central Intelligence Agency
– Universal Access
– Defense Technical Information
– Distance Learning
Center
– Intranet Technology
– Rural Development, Department of • Staff Training
Agriculture
• Electronic Meeting Spaces
– Department of Education
– Department of Housing and Urban
Development
– National Biological Service
– National Institutes of Health
– National Oceanic and Atmospheric
Administration
– NASA
– National Science Foundation
– National Security Agency
– Nuclear Regulatory Commission
http://skydive.ncsa.uiuc.edu/
National Computational Science Alliance
TRACE - Advancing Access to Technology
http://trace.wisc.edu/world/
National Computational Science Alliance
Global Collaboration and Tele-Immersion
Enabled by EVL CAVERNsoft
•
•
•
•
•
Supercomputing ’97
NICE Persistent Simulation
Avatars Doing Hokey Pokey
17 sites
Alliance ‘99 in Cyberspace ??
Source: Jason Leigh, Andy Johnson, EVL, Tom Coffin, NCSA
National Computational Science Alliance