Neil Geddes
CCLRC Head of e-Science
Director of the UK Grid Operations Support Centre
Andrew Richards
NGS Coordinator
GOSC – Grid Support Centre
• The vision, recent history and Organisation
• Roles and Relationships with others
• GOSC, NGS, GSC, EGEE/LCG, GRIDPP,
OMII, ETF
• Where we want to go next
Vision
This UK Grid Operation Support Centre is a distributed “virtual centre” providing
deployment and operations support for the UK e-Science programme. The centre is a
collaboration of CCLRC, the University of Manchester, the University of Oxford,
the University of Edinburgh and the White Rose Grid at the University of Leeds.
The core of the GOSC is built around operation of the National Grid Service (NGS).
The GOSC will support UK services for user authentication, user authorization and
project organization, credential management, resource discovery, access portals to
facilitate collaborative research and resource sharing across the UK and
internationally.
The principal roles of the GOSC (as defined in the original call) include:
–
–
–
–
–
–
–
Middleware deployment
Central grid service support
General User support and helpdesk
Network services
Grid Security
User and Administrator support
Interoperability and collaboration with international projects, e.g. EGEE
and TeraGrid
UK Core e-Science programme Situation Today
National Grid Service
Level-2 Grid
* Leeds
Manchester *
* DL
* Oxford
RAL *
N
G
S
UK Grid Operations
Support Centre
GOSC Roles

UK Grid Services

National Services


NGS Services




Authentication, authorisation, certificate management, VO management,
security, network monitoring, help desk + support centre.
Job submission, simple registry, data transfer, data access and
integration, resource brokering, monitoring and accounting, grid
management services, workflow, notification, operations centre.
NGS core-node Services

CPU, (meta-) data storage, key software

Integration testing, compatibility & Validation Tests, User Management,
training
Services to be coordinated with others (eg OMII, NeSC, LCG):
Administration:



Policies and acceptable use
SLA’s, SLD’s
Coordinate deployment and Operations
GOSC + ETF
•
Core of GOSC built around experience in deploying and running National
Grid Service (NGS)
– Support service
•
Important to coordinate and integrate this with deployment and
operations work in EGEE, LCG and similar projects.
– e.g. EGEE – low level services, CA, GOC, CERT...
•
Focus on deployment and operations, NOT development.
EGEE…
Other software
sources
Prototypes &
specifications
NGS
ETF
Software with proven
capability & realistic
deployment
experience
OMII
‘Gold’ services
Feedback & future requirements
Deployment/testing/advice
UK
Campus
Operations and
other
Grids
ETF
•
Registry
•
Secure Flocking of Condor
– A freely available UDDI implementation has been deployed/tested
between 4 sites
– Experience passed on to the GRIMOIRES OMII project.
– Condor pools at 4 sites have been flocked together, through firewalls
– authentication through use of X.509 certifcates
– OMII test bed
• Portals
– Support access to the NGS.
– Tied in with JISC VRE developments
•
Evaluations
–
–
–
–
InnerGrid - Contractual issues delayed start - just started.
OMII – Start later this month
GT4 – Start later this month
gLite – start next month
Stuff We Don’t Do
• Run a repository
• Develop software
– contribute to developments to influence/adapt
cf
“I’ve got one of those you can have. You just need to …”
• (Training – Edinburgh/NeSC are part of
GOSC)
• Extensive user hand-holding and app support
– Need the e-Science Centres
– Priorities will be driven by users
One Stop Shop
Click for help
Grid Operations Centre
Responsibilities in EGEE
UK focused screen
UKERNA work to be
integrated
Authentication, authorisation, certificate management,
VO management, security.
Helpdesk
FAQ
OMII
LCG
•Used for batch
production Now.
• worldwide de
facto standards
•Currently trying to
interface analysis S/W
• on top of gLite
from EGEE
•Need to move out of
the physics dept’s
GRIDPP
•
UK Contribution to LCG
•
GridPP1 (2001-2004)
•
GridPP2 (2004-2007)
– Also supports current users
– 33% deployment/operations
– 33% middleware dev.
– 33% applications
– 60% deployment/operations
• LCG2 -> EGEE
•
– 15% middleware dev.
– 25% applications
Not just PPARC funding
– Universities
• support LHC
• benefit from grid experience
• You should know/meet these
people
•
•
Start from LCG2
“Harden” middleware
•
•
Expand applications
€32 from EU
•
–
–
–
The EU Grid Infrastructure
50% deployment/operations
lots at CERN
•
matched by PP
UK + I
–
–
–
training
GOC dev + ops
regional deployment+support
•
T2 coordinators
NGS “Today”
Interfaces
OGSI::Lite
Projects
e-Minerals
e-Materials
Orbital Dynamics of Galaxies
Bioinformatics (using BLAST)
GEODISE project
UKQCD Singlet meson project
Census data analysis
MIAKT project
e-HTPX project.
RealityGrid (chemistry)
Users
Leeds
Oxford
UCL
Cardiff
Southampton
Imperial
Liverpool
Sheffield
Cambridge
Edinburgh
QUB
BBSRC
CCLRC.
WSRF::Lite
“Tomorrow”
GOSC Timeline
NGS WS Service
NGS Expansion
(Bristol, Cardiff…)
NGS Production
Service
NGS WS Service 2
OGSA-DAI
NGS Expansion
WS2 plan
WS plan
Q2
Q3
Q4
Q1
2004
Q2
Q3
2005
Q4
Q1
Q2
OMII release
gLite release 1
EGEE gLite alpha
release
Q3
2006
EGEE gLite release
OMII Release
Web Services
based
National Grid
Infrastructure
UofD
U
of
A
H
P
C
x
Commercial
Provider
PSRE
Man. Leeds
GOSC
RAL
Oxford
C
S
A
R
U
of
B
U
of
C
NGS Core Nodes: Host core services, coordinate integration, deployment and support
+free to access resources for all VOs. Monitored interfaces + services
NGS Sites:
Integrated with NGS, some services/resources available for all VOs
Monitored interfaces + services
NGS Connected Sites: Integrated with NGS, support for some VO’s
Monitored interfaces (+security etc.)
UK e-Infrastructure
Users get common access, tools, information,
Nationally supported services, through NGS
Regional and
Campus grids
Integrated
internationally
VRE, VLE, IE
LHC
ISIS TS2
HPCx + HECtoR
SRB service
OGSA-DAI service
Production Status
•
•
•
•
•
•
•
•
•
•
TODAY
4 new core nodes operational
132 Users registered (32 since 1 September ’04)
Grid enabled – Globus v2 (VDT distribution v1.2) at present
BDII information service (GLUE + MDS Schemas)
Data Services – Oracle and SRB
Growing base of user applications
MyProxy and CA services provided by UK Grid Support Centre
VO Management Software – LCG-VO
User support: Helpdesk
•
•
•
•
•
Next…
Other Middleware [gLite/OMII etc…]
NGS Portal
Resource Broker
SRB pre-production service
User Example
GODIVA
Diagnostics Study of
Oceanography Data
EVE
Excitations and
Visualisation Project
Integrative Biology
Simulation of Strain in
Soft Tissue under Gravity
How do I Join as a New Site?
• Acceptable use and Security policies
• Install required interfaces (~EGEE)
– VDT
– EGEE CE and SE interfaces (and
Authorisation)
– Monitoring and accounting
• Provide services as defined in your own
SLD
– Buys you representation at the board (?)
Core services to facilitate collaborative (grid) computing – run by GOSC
UK e-Science Cert.
•Authentication (PKI X509)
gsi-ssh, globus-job-submit, condorG
•Job submission/batch service
EDG-RB
•Resource brokering
VOM/VOMS
•Authorisation
•Virtual Organisation management VOMS (+Grid3/EGEE)
myProxy(++)
•Certificate management
BDII/Glue
•Information service
•Data access/integration services (SRB/OGSA-DAI/DQPS)
? ETF ?
•National Registry (of registry’s)
? EGEE ?
•Data replication
? EGEE ?
•Data caching
EGEE/LCG + ETF +TeraGrid
•Grid monitoring
EGEE/LCG/ETF/GGF
•Accounting
Where Next?
• Make the NGS work
– Resource Broker/scheduler
– VO/Project support
– Monitoring and Accounting
• Compatibility with EGEE
• Define and agree criteria for success
• Web Services
• National e-Infrastructure
– Science and Innovation strategy 2004-2014
Timeline
NGS WS Service
NGS Expansion
(Bristol, Cardiff…)
NGS Production
Service
NGS WS Service 2
OGSA-DAI
NGS Expansion
WS2 plan
WS plan
Q2
Q3
Q4
Q1
2004
Q2
Q3
2005
Q4
Q1
Q2
2006
OMII release
gLite release 1
EGEE gLite alpha
release
Q3
EGEE gLite release
OMII Release
Summary
• We are in the game of providing a service
– built on leading edge academic stuff !
• The challenge
– not the latest and greatest grid
– not what any given user wants
• The solution
– want to make it work
• for our researchers
• for our institutions
– one site will not make a useful grid
• Sign people/users up (to the vision)
– “get out more”
GOSC Director
Neil Geddes: n.i.geddes@rl.ac.uk
NGS Grid Coordinator
Andrew Richards: a.j.richards@rl.ac.uk
Websites
http://www.grid-support.ac.uk
http://www.ngs.ac.uk
Helpdesk (via Grid Support Centre)
Email: support@grid-support.ac.uk
The End