Argonne National Laboratory
USC Information Sciences Institute http://www.globus.org








Introduction to Grid Computing
Some Definitions
Grid Architecture
The Programming Problem
The Globus Toolkit™
– Introduction, Security, Resource
Management, Information Services, Data
Management
Related work
Futures and Conclusions
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 2






A biochemist exploits 10,000 computers to screen 100,000 compounds in an hour
1,000 physicists worldwide pool resources for petaop analyses of petabytes of data
Civil engineers collaborate to design, execute, & analyze shake table experiments
Climate scientists visualize, annotate, & analyze terabyte simulation datasets
An emergency response team couples real time data, weather model, population data
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 3






A multidisciplinary analysis in aerospace couples code and data in four companies
A home user invokes architectural design functions at an application service provider
An application service provider purchases cycles from compute cycle providers
Scientists working for a multinational soap company design a new product
A community group pools members’ PCs to analyze alternative designs for a local road
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 4

Daresbury Grid Testbed
IBM PPC cluster
(4xPPC, AIX, Web server)
IBM PPC (AIX,
MyProxy, server)
Beowulf1 (32xPIII,
Linux, PBS)
SP (48 xPower, AIX,
Loadle veler)
LoadLeveler
Globus
SUN cluster (2xUltra,
Solaris, GIIS server)
Loki (64xAlpha, Linux, PBS)
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 5



Flexible, secure, coordinated resource sharing among dynamic collections of individuals, institutions, and resource
From “The Anatomy of the Grid: Enabling Scalable Virtual Organizations”
Enable communities (“virtual organizations”) to share geographically distributed resources as they pursue common goals -- assuming
the absence of…
– central location,
– central control,
– omniscience,
– existing trust relationships.
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 6




Resource sharing
– Computers, storage, sensors, networks, …
– Sharing always conditional: issues of trust, policy, negotiation, payment, …
Coordinated problem solving
– Beyond client-server: distributed data analysis, computation, collaboration, …
Dynamic, multi-institutional virtual organisations
– Community overlays on classic org structures
– Large or small, static or dynamic
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 7





Moore’s law improvements in computing produce highly functional endsystems
The Internet and burgeoning wired and wireless provide universal connectivity
Changing modes of working and problem solving emphasize teamwork, computation
Network exponentials produce dramatic changes in geometry and geography
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 8




Network vs. computer performance
– Computer speed doubles every 18 months
– Network speed doubles every 9 months
– Difference = order of magnitude per 5 years
1986 to 2000
– Computers: x 500
– Networks: x 340,000
2001 to 2010
– Computers: x 60
– Networks: x 4000
Moore’s Law vs. storage improvements vs. optical improvements. Graph from Scientific American (Jan-
2001) by Cleo Vilett, source Vined Khoslan, Kleiner, Caufield and Perkins.
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 9



“Grid Computing” has much in common with major industrial thrusts
– Business-to-business, Peer-to-peer, Application
Service Providers, Storage Service Providers,
Distributed Computing, Internet Computing…
Sharing issues not adequately addressed by existing technologies
– Complicated requirements: “run program X at site Y subject to community policy P, providing access to data at Z according to policy Q”
– High performance: unique demands of advanced & high-performance systems
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 10

Making Grid computing a reality





Close collaboration with real Grid projects in science and industry
Development and promotion of standard Grid protocols to enable interoperability and shared infrastructure
Development and promotion of standard Grid software APIs and SDKs to enable portability and code sharing
The Globus Toolkit™: Open source, reference software base for building grid infrastructure and applications
Global Grid Forum: Development of standard protocols and APIs for Grid computing
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 11

Advanced Photon Source wide-area dissemination real-time collection archival storage desktop & VR clients with shared controls tomographic reconstruction
DOE X-ray grand challenge: ANL, USC/ISI, NIST, U.Chicago
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 12

~PBytes/sec
Online System ~100 MBytes/sec
1 TIPS is approximately 25,000
SpecInt95 equivalents
Offline Processor Farm
There is a “bunch crossing” every 25 nsecs.
There are 100 “triggers” per second
~20 TIPS
~100 MBytes/sec
Each triggered event is ~1 MByte in size
Tier 0
~622 Mbits/sec or Air Freight (deprecated)
Tier 1
France Regional
Centre
Germany Regional
Centre
Italy Regional
Centre
FermiLab ~4 TIPS
~622 Mbits/sec
Tier 2
~622 Mbits/sec
Caltech
~1 TIPS ~1 TIPS ~1 TIPS
Tier2 Centre
~1 TIPS
Tier2 Centre
~1 TIPS
Physics data cache
Institute
~1 MBytes/sec
Institute
Physicists work on analysis “channels”.
Each institute will have ~10 physicists working on one or more channels; data for these channels should be cached by the institute server
Tier 4
Physicist workstations
October 22, 2001
Image courtesy Harvey Newman, Caltech
Intro to Grid Computing and Globus Toolkit™ 13




Looking for the solution to the
NUG30 quadratic assignment problem
An informal collaboration of mathematicians and computer scientists
Condor-G delivered 3.46E8
CPU seconds in 7 days (peak
1009 processors) in U.S. and
Italy (8 sites)
14,5,28,24,1,3,16,15,
10,9,21,2,4,29,25,22,
13,26,17,30,6,20,19,
8,18,7,27,12,11,23
MetaNEOS: Argonne, Iowa, Northwestern, Wisconsin
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 14



NEESgrid: national infrastructure to couple earthquake engineers with experimental facilities, databases, computers, & each other
On-demand access to experiments, data streams, computing, archives, collaboration
NEESgrid: Argonne, Michigan, NCSA, UIUC, USC
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 15



Community =
– 1000s of home computer users
– Philanthropic computing vendor
(Entropia)
– Research group
(Scripps)
Common goal= advance AIDS research
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 16

Tier0/1 facility
Tier2 facility
Tier3 facility
10 Gbps link
2.5 Gbps link
622 Mbps link
Other link
U.S. PIs: Avery, Foster, Gardner, Newman, Szalay www.ivdgl.org
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 17





Globus Project™
– www.globus.org
Grid Forum
– www.gridforum.org
Book (Morgan Kaufman)
– www.mkp.com/grids
– www.grid-support.ac.uk
October 22, 2001 Intro to Grid Computing and Globus Toolkit™ 18