Open Science Grid
Operating the Open Science Grid
Doug Olson, LBNL
OSG Consortium Meeting
Milwaukee, WI
20 July 2005
20 July 2005
1
Open Science Grid
Contents
• The roles
• The players
• The script
– Infrastructure services
– Service desk functions
– Engineering functions
• Examples of some key scenes
• Acknowledgements
• How to get your tickets
20 July 2005
Operating OSG, Olson, Milwaukee
2
Open Science Grid
The Roles
Logical
View
e.g. VDT
(Globus,
Condor, …)
Catalog,
discovery, identity,
brokering, …
Users
(scientists, students,
engineers, …) and
Applications
20 July 2005
Compute, storage,
(network in future)
(see later
slides)
Operating OSG, Olson, Milwaukee
OSG Doc 47
3
Open Science Grid
Roles (II)
Physical
View
Real support
organizations
often play multiple
roles
Lines represent
communication
paths and,
in our model,
agreements.
Gray shading
indicates that OSG
Operations composed
of effort from all the
support centers.
We have not
progressed very
far with
agreements yet.
20 July 2005
Operating OSG, Olson, Milwaukee
4
Open Science Grid
Roles (III)
Have recognized need for general open support, but no
one is
Physical
contracted to provide it, so a “best effort” community View
support
activity has started and is still taking shape.
See Fred Luehring & Burt Holzman.
20 July 2005
Operating OSG, Olson, Milwaukee
Community
Support
5
Open Science Grid
The Players (I)
(partial list of support centers, span labs and universities,
formed or forming as of 7/19/05)
Support Center
Problem Reporting Address
Community Supported
BNL/USATLAS
usatlas-support-l@lists.bnl.gov
US ATLAS users, Tier1 & Tier2 centers
Fermilab
helpdesk-admin@fnal.gov
Fermilab Virtual Organization (VO), Fermilab User VOs (non-CMS and nonSDSS), FermiGrid Sites, Fermilab OSG Services (DNS, Mailists and Web Portal)
GRASE
grid-help@ccr.buffalo.edu
GRASE-CCR-ACDC, GRASE VO
iGOC
goc@opensciencegrid.org
iVDGL, OSG Operations
LIGO
rmurali@psu.edu
LIGO Scientific Collaboration
NERSC
consult@nersc.gov
PDSF facility and users, STAR
PROD_SLAC
osg-support@slac.stanford.edu
SLAC facilities, BaBar, partial ATLAS & CMS VOs
UC CI
teraport-support@ci.uchicago.edu
Teraport, best effort for OSG VOs
US CMS
uscms-ops@uscms.org
US CMS VO,
RPs: CMS farms at FNAL, UCSD, UW, Caltech, UFL, Purdue, MIT, UNL
VDT
vdt-support@cs.wisc.edu
VDT software distribution
Community
Support Center
Osg-general@opensciencegrid.org
any OSG participant
20 July 2005
Operating OSG, Olson, Milwaukee
6
Open Science Grid
The Players (II)
(list of registered VOs as of 7/19/05)
VO
User Support URL
ATLAS
usatlas-support-l@lists.bnl.gov, https://cts.acf.bnl.gov/NoAuth/Submit_Problem_menu.html
iVDGL
http://igoc.ivdgl.indiana.edu/
GRASE
grid-help@ccr.buffalo.edu
LIGO
rmurali@psu.edu
MIS
http://igoc.ivdgl.indiana.edu/
SDSS
neha@fnal.gov
STAR
stargrid-l@lists.bnl.gov, http://www.star.bnl.gov/STAR/comp/Grid/
US CMS
uscms-ops@uscms.org, http://www.uscms.org/SoftwareComputing/Grid/
other
uscms-ops@uscms.org, http://www.uscms.org/SoftwareComputing/Grid/
20 July 2005
Operating OSG, Olson, Milwaukee
7
Open Science Grid
Guidance
Tables in
preceeding
slides
provide
guidance to
people
looking for
assistance
on the
support web
pages.
20 July 2005
Operating OSG, Olson, Milwaukee
8
Open Science Grid
Infrastructure
OSG Operations -Services and Providers
VO Support Center
RP Support Center
Service Support Center - grid services
Service Support Center - middleware
Operations Support Center
Support Services
Engineering
Infrastructure
trouble ticketing system and interface among systems
monitoring tools development and provisioning
accounting services provisioning
discovery services provisioning
identity services
grid information index
gridcat
VOMS
knowledgebase
mailing lists
web and information repositories
20 July 2005
Operating OSG, Olson, Milwaukee
9
Open Science Grid
Service Desk
OSG Operations -Services and Providers
VO Support Center
RP Support Center
Service Support Center - grid services
Service Support Center - middleware
Operations Support Center
Support Services
Service Desk
faciliate and support communications
coordinate and track problems and security incidents
coordinate and track requests for assistance
respond to problems, security incidents, and requests for assistance
publish status, activity, accounting, and problem management reports
maintain a repository of support, process, and policy information
schedule and coordinate grid service and middleware changes
monitor the status of grid resources
monitor policy compliance
20 July 2005
Operating OSG, Olson, Milwaukee
10
Open Science Grid
Engineering
OSG Operations -Services and Providers
VO Support Center
RP Support Center
Service Support Center - grid services
Service Support Center - middleware
Operations Support Center
Support Services
Engineering
maintain grid-controlled software packages and cache
provide common grid software not supported through VDT
verify software compatibility
provision releases of OSG middleware
provide site installation and configuration support
provide ease-of-installation tools
develop instructions on how to plug things together
troubleshoot grid service failures
troubleshoot application failures
provide and maintain common grid services
provide development guidance and assistance
provide specialized services for VO's and applications
create APIs to information resources
liaison middleware and application developers
20 July 2005
Operating OSG, Olson, Milwaukee
11
Open Science Grid
Trouble Ticket System
• Used by IU Global NOC & Grid3, now in production for OSG
People from most
support centers
do/will have accounts
and can assign
tickets directly to
appropriate SC.
All support centers
will be known to the
system.
20 July 2005
Operating OSG, Olson, Milwaukee
12
Open Science Grid
Provisioning Activity
•
•
•
•
Leigh Grundhoefer, Dane Skow, co-chairs
Guided (pushed, trimmed, hammered, …) initial OSG software release
A major piece of work!
Future releases will be provisioned ( hopefully with less effort.)
20 July 2005
Operating OSG, Olson, Milwaukee
13
Open Science Grid
Problem tracking
Problems, issues, open trouble tickets are discussed in a regular teleconference.
The associated email list is osg-operations@opensciencegrid.org.
20 July 2005
Operating OSG, Olson, Milwaukee
14
Open Science Grid
Acknowledgements
Operations Activity
Support Centers TG
Abhishek Singh Rana
Adam Walters
Alain Roy
Alan Sill
Alex Sim
Alistair Mills
Bockjoo Kim
Bruce Gibbard
Dane Skow
John Rosheck
Jon Bakken
Abhishek Rana
John Rosheck
Bockjoo Kim
Karthik Arunachalam
Booker Bense
Jorge Rodriguez
Craig Prescott
Keith Chadwick
Dan Bradley
Leigh Grundhoefer
Dan Yocum
Lisa Giacchetti
Dane Skow
Lothar Bauerdick
Doug Olson
Mark Kaletka
Doug Pearson
Frederick Luehring
Paul Avery
Fu-Ming Tsai
Razvan Popescu
Gabriele Carcassi
Rick Thies
Gabriele Garzoglio
Rob Gardner
GOC
Rob Quick
Holzman, Burt
Jeff Weber
Ruth Pordes
Horst Severini
Jim Shank
Stan Naymola
Iwona Sakrejda
John Huth
Vicky White
Frank van Lingen
Holzman, Burt
Ian Fisk
Leigh Grundhoefer
Lisa Giacchetti
Matt Allen
Matteo Melani
Neha Sharma
Ping Yeh
Doug Pearson
Fred Luehring
Lawrence Sorrillo
Patrick McGuigan
Markus Schulz
Doug Olson
Kyle Gross
Preston Smith
Razvan Popescu
Rob Quick
Ruth Pordes
Stephen Simms
Steven Timm
Suresh Singh
Jason A. Smith
Thomas Wang
Jeff Weber
Young, Charles C.
chairs
20 July 2005
Operating OSG, Olson, Milwaukee
15
Open Science Grid
To get Your tickets:
0. (You already read How to Participate with OSG.)
1. Register your
resource, service, VO,
and/or support center.
2. Sign up on the
appropriate email lists.
3. See Rob Quick’s talk
tomorrow.
20 July 2005
Operating OSG, Olson, Milwaukee
16
Open Science Grid
But the end of my talk
20 July 2005
Operating OSG, Olson, Milwaukee
17