Using GT4
Bill Allcock
Charles Bacon
Lisa Childers
Jarek Gawor
Argonne National Laboratory
University of Chicago
Amy Krause
National e-Science Centre
History
In the early 90s, Ian Foster (ANL, U-C) and
Carl Kesselman (USC-ISI) enjoyed helping
scientists apply distributed computing


Opportunities seemed ripe for the picking
Application of technology always uncovers
new and interesting requirements

Science is cool!

Big/Innovative science is even cooler!
UK Globus Week: April 2005
GT4 User Introduction
2
History (continued)
While helping to build/integrate a diverse
range of applications, the same problems
kept showing up over and over again




Too many different security systems
Too many different scheduling/execution
mechanisms
Too many different storage systems
Too many different monitoring/status/event
systems
UK Globus Week: April 2005
GT4 User Introduction
3
What Kinds of Applications?

Computation intensive




Data intensive



Experimental data analysis (high-energy physics)
Image and sensor analysis (astronomy, climate study, ecology)
Distributed collaboration




Interactive simulation (climate modeling)
Very large-scale simulation and analysis (galaxy formation,
gravity waves, battlefield simulation)
Engineering (parameter studies, linked component models)
Online instrumentation (microscopes, x-ray devices, etc.)
Remote visualization (climate studies, biology)
Engineering (large-scale structural testing, chemical engineering)
In all cases, the problems were big enough that they required
people in several organization to collaborate and share computing
resources, data, instruments
UK Globus Week: April 2005
GT4 User Introduction
4
What Types of Problems?


Too hard to keep track of authentication data
(ID/password) across institutions
Too hard to monitor system and application status
across institutions

Too many ways to submit jobs

Too many ways to store & access files and data

Too many ways to keep track of data

Too easy to leave “dangling” resources lying around
(robustness)
UK Globus Week: April 2005
GT4 User Introduction
5
The Globus Approach
UK Globus Week: April 2005
GT4 User Introduction
6
Without the Grid
Web
Browser
Application
Developer
10
Off the
Shelf
12
Globus
Toolkit
0
Grid
Community
0
Simulation
Tool
Web
Portal
Data
Viewer
Tool
Chat
Tool
B
Compute
Server
Application services
organize VOs & enable
access to other services
Camera
Telepresence
Monitor
Data
Catalog
Credential
Repository
UK Globus Week: April 2005
Compute
Server
Registration
Service
Certificate
authority
Users work
with client
applications
A
Collective services
aggregate &/or
virtualize resources
GT4 User Introduction
Camera
C
Database
service
D
Database
service
E
Database
service
Resources implement
standard access &
management interfaces
7
The Role of the Globus Toolkit


The Globus Toolkit is a collection of solutions to
problems that frequently come up when trying to build
collaborative distributed applications
Heterogeneity



To date (v1.0 - v4.0), the Toolkit has focused on
simplifying heterogenity for application developers
We aspire to include more “vertical solutions” in future
versions
Standards


Our goal has been to capitalize on and encourage use of
existing standards (IETF, W3C, OASIS, GGF)
The Toolkit also includes reference implementations of
new/proposed standards in these organizations
UK Globus Week: April 2005
GT4 User Introduction
8
With the Grid
Globus
Web
Browser
GRAM
Simulation
Tool
Globus
GRAM
Globus Index
Service
CHEF
Compute
Server
Compute
Server
Camera
Application
Developer
2
Off the
Shelf
9
Globus
Toolkit
Grid
Community
4
4
Data
Viewer
Tool
Telepresence
Monitor
Globus
CHEF Chat
Teamlet
DAI
Globus
MCS/RLS
MyProxy
DAI
DAI
Application services
organize VOs & enable
access to other services
UK Globus Week: April 2005
Globus
Globus
Certificate
Authority
Users work
with client
applications
Camera
Collective services
aggregate &/or
virtualize resources
GT4 User Introduction
Database
service
Database
service
Database
service
Resources implement
standard access &
management interfaces
9
“Standard Plumbing” for the Grid

Not turnkey solutions, but building blocks and tools for
application developers and system integrators


Some components (e.g., file transfer) go farther than
others (e.g., remote job submission) toward end-user
relevance
Since these solutions exist and others are already using
them (and they’re free), it’s easier to reuse than to
reinvent

And compatibility with other Grid systems comes for free
UK Globus Week: April 2005
GT4 User Introduction
10
How To Use the Globus Toolkit

Today the majority of the public
interfaces are usable by application
developers and system integrators
 There are relatively few end-user
interfaces
 You can’t just give it to end users
(scientists, engineers, marketing
specialists) and tell them to do
something useful
UK Globus Week: April 2005
GT4 User Introduction
11
Moving Forward with GT4
Today
Goal
UK Globus Week: April 2005
GT4 User Introduction
12
Overview of Today’s Presentations

Security

MyProxy

GridFTP

Java WS Core

OGSA-DAI

RFT

RLS

GRAM

MDS

Case Study: Grid 3
UK Globus Week: April 2005
GT4 User Introduction
13