Knowledge Management and Corporate Intranets • Talk to visiting team from Fisher Scientific • January 13, 1998 National Computational Science Alliance The Alliance National Technology Grid National Computational Science Alliance NSF vBNS and PACI Mutually Interdependent NCSA Alliance NPACI Both NCSA Alliance and NPACI Other High Performance Connection sites Current vBNS “Backbone” sites National Computational Science Alliance Alliance Applications Technologies Teams Science and Engineering Driving the Grid • • • • • • Cosmology (5) Environment Hydrology (11) Chemical Engineering (7) Bioinformatics (9) Nanomaterials (11) Scientific Instruments (8) National Computational Science Alliance NCSA Biology Workbench Web Interface to Programs and to Data • Wide International User Community – http://biology.ncsa.uiuc.edu/ • Available Commercially as: – The Bioinformatics Workbench – MDL Information Systems – http://www.mdli.com/bioinformatics/welcome.html National Computational Science Alliance I-Way ‘95 Distributed Use of Scientific Instruments National Computational Science Alliance How to Find out More About the Alliance See also http://alliance.ncsa.uiuc.edu National Computational Science Alliance NCSA Industrial Partners • • • • • • • • Allstate Insurance Co. Boeing Company Caterpillar Inc. Eastman Kodak Co. Eli Lilly and Company FMC Corporation Ford Motor Company J. P. Morgan • • • • • • • Motorola, Inc. Phillips Petroleum Co. SABRE Group, Inc. Schlumberger Sears, Roebuck & Co. Shell Oil Company Tribune Company National Computational Science Alliance NCSA’s Three Major Technology Foci • Scalable Computing – Clustered Computing Architectures – Evolution to NT/Intel • Knowledge Management – Enterprise Intranets & Decision Support – Automated Discovery & Learning • Virtual Environments – Desktop to CAVE – Tele-immersion National Computational Science Alliance Exponential Cascade: From Leading Edge to Consumer Electronics Source: Silicon Graphics, 1997 1985 Cray X-MP Cost:$8,000,000 60,000 watts of power No Built in Graphics 56 kbps NSFnet Backbone 1997 Nintendo 64 Cost: $149 5 watts of power Interactive 3D Graphics 64 kbps ISDN to Home National Computational Science Alliance Exponential Growth in National User Demand Will Drive Grid Capabilities Source: Quantum Research Database National Computational Science Alliance Three Architectures for High End Computing • Clusters of DSM – SGI Origin2000 UNIX DSMs – HP Exemplar UNIX DSM • Clusters of SMPs – SGI Power Challenge UNIX SMPs – HP and Compaq NT/Intel SMPs • Networks of Computers – UWisc. Condor for UNIX Workstations – NCSA Symbio for NT Desktops NCSA FY98 National Computational Science Alliance World’s Largest Unclassified SGI/Cray Origin NCSA’s Cluster of DSMs Origin Array Processors 128 4x64 4x32 10x16 Power Challenge Array 128 Processors Equals a 512 Processor CM-5 National Computational Science Alliance Computing on the University of Wisconsin Condor Pool Condor Cycles CondorView, Courtesy of Miron Livny, Todd Tannenbaum(UWisc) National Computational Science Alliance How Did a Supercomputer Center Get Into Enterprise Knowledge Management? • Microprocessor Market Convergence – NT/Intel Challenging UNIX/RISC • Desktop Software Tool Development – From NCSA Telnet to NCSA Mosaic • Large Scientific Databases – From Scientific Visualization to Info Viz • Emergence of Distributed Object Architecture – Java, ActiveX, CORBA, and the Web • Supercomputer Center to PACI – Need to Create Alliance Intranet and Collaboratory National Computational Science Alliance The Coming Integration of Technical and Commercial Computing • The Emergence of High Performance Commercial Computing – Computational Knowledge Management – Focus on: – Large Data Sets and Information Visualization – AI Techniques for Data Mining – Optimization and Decision Support – Financial “Rocket Science” • NT / UNIX Interoperability and Scalability – HP and SGI UNIX DSMs – Scalable Microsoft NT Clusters and NCSA Symbio – HP/Intel Merced Processor in FY99-00 National Computational Science Alliance NCSA / Alliance NT Projects • NCSA Microsoft Intranet – Internet Explorer 4.0 and Office 97 – Active Desktop (ActiveX & Push Technologies) – NT 5.0 (Active Directory, Kerberos, Dfs) • NT/UNIX Interoperability Testbed – HP NT Pentium Pro Classroom & NT/UNIX Servers – UNIX Programming Environment on NT PC • Computing on NT Network – NCSA Symbio and Univ. of Wisconsin Condor • NT Cluster Scalability – Microsoft Wolfpack – Tightly Coupled SMP Clusters (Chien / Iyer) National Computational Science Alliance Allstate Pioneering an NT Intranet • Standard Software Environment – Microsoft Office – Microsoft Outlook / Exchange – Internet Explorer – Windows NT Desktop / Server for Intel Platforms – Oracle Database Technology – CA Unicenter (TNG) • TCP/IP Network – T3 Backbone – Sonet Ring Technology • Partnering with NCSA as Microsoft / HP Testbed • Partnering with NCSA and Computer Associates National Computational Science Alliance Performance Monitoring and Capacity Planning • • • • Efficient Usage of the Resources Performance Data Collection Automated Analysis to Ensure Service Levels Workloads Management – Load Balancing – Scheduling – Remote Collaboration Sessions • Capacity Planning Tools and Models National Computational Science Alliance The Alliance Intranet Support for a Virtual Organization • Browser Interface Augmented by Java • Threaded Discussion Spaces • Federated Repository of Documents – Backended by Lotus Domino – Alliance Work Statements – Alliance Power Points • Administrative Tools – Contacts – Calendar • Individualized Security Profiles National Computational Science Alliance The Emergence of Knowledge Management October 20, 1997 National Computational Science Alliance NCSA Knowledge Management Workspaces Object and Relational Databases Distributed Object Technology Collections Data Warehouses Agents ORBs (CORBA / ActiveX ) Scripting JavaBeans / Enterprise Objects Java / Smalltalk Knowledge Discovery and Visualization SGI Mineset AVS, VDI Optimization Optimization Tools Analysis Collaborations (Habanero, Tango) Automated Discovery Simulation Engine CAVE Devices VRML Application Specific Browser Browser National Computational Science Alliance Visual Data Mining of Total Insurance Claims Dataset Allstate Insurance, NCSA Using SGI Mineset National Computational Science Alliance Alliance Researchers Using a Digital Video Computational Infrastructure CAVE Virtual Director Habanero Teams Internet, vBNS Desktop Video Teleconferencing Individual Desktops Create Digital Video Animation Concurrently with Supercomputing Digital Video Server = Digital Video Streams National Computational Science Alliance Alliance National Technology Grid Workshop and Training Facilities Powered by Silicon Graphics Linked by the NSF vBNS National Computational Science Alliance Caterpillar’s Distributed Virtual Reality Data courtesy of Valerie Lehner, NCSA, 1996 National Computational Science Alliance Bringing Scientific / Information Visualization & Virtual Environments to the NT Desktop • Early Partner with SGI NT Supergraphics – Port CAVE to NT – Work with Alias/Wavefront on NT • VRML and Java3D – Compatible with CAVE Libraries – Develop Specific Applets – Integration with Collaborative Environments • Work with AVS, VDI, and other Third Party • Partner with Graphics Team at Microsoft National Computational Science Alliance