• The vision, recent history and Organisation
• Roles and Relationships with others
• GOSC, NGS, GSC, EGEE/LCG, GRIDPP,
OMII, ETF
Neil Geddes
CCLRC Head of e-Science
Director of the UK Grid Operations Support Centre
• Where we want to go next
Andrew Richards
NGS Coordinator
GOSC – Grid Support Centre
Vision
This UK Grid Operation Support Centre is a distributed “virtual centre” providing
deployment and operations support for the UK e-Science programme. The centre is a
collaboration of CCLRC, the University of Manchester, the University of Oxford,
the University of Edinburgh and the White Rose Grid at the University of Leeds.
The core of the GOSC is built around operation of the National Grid Service (NGS).
The GOSC will support UK services for user authentication, user authorization and
project organization, credential management, resource discovery, access portals to
facilitate collaborative research and resource sharing across the UK and
internationally.
UK Core e-Science programme Situation Today
National Grid Service
Level-2 Grid
The principal roles of the GOSC (as defined in the original call) include:
–
–
–
–
–
–
–
Middleware deployment
Central grid service support
General User support and helpdesk
Network services
Grid Security
User and Administrator support
Interoperability and collaboration with international projects, e.g. EGEE
and TeraGrid
* Leeds
Manchester *
* DL
RAL ** Oxford
GOSC Roles
{
UK Grid Services
{
National Services
{
NGS Services
{
{
N
G
S
{
Job submission, simple registry, data transfer, data access and
integration, resource brokering, monitoring and accounting, grid
management services, workflow, notification, operations centre.
{
NGS core-node Services
{
Services to be coordinated with others (eg OMII, NeSC, LCG):
{
CPU, (meta-) data storage, key software
{
Integration testing, compatibility & Validation Tests, User Management,
training
Administration:
{
UK Grid Operations
Support Centre
Authentication, authorisation, certificate management, VO management,
security, network monitoring, help desk + support centre.
{
{
Policies and acceptable use
SLA’s, SLD’s
Coordinate deployment and Operations
1
GOSC + ETF
Steering Committee
Audit Board
USERS
Director
GOSC
•
Core of GOSC built around experience in deploying and running National
Grid Service (NGS)
Management Board
•
Important to coordinate and integrate this with deployment and
operations work in EGEE, LCG and similar projects.
•
Focus on deployment and operations, NOT development.
– Support service
– e.g. EGEE – low level services, CA, GOC, CERT...
Operations Manager/
Technical Director
Development
Manager
Operations Board
ETF
TRAINING
EGEE…
Other software
sources
Prototypes &
specifications
NGS
ETF
OMII
‘Gold’ services
Networking
Security
NGS
GOC
GSC
ETF
•
Registry
•
Secure Flocking of Condor
– A freely available UDDI implementation has been deployed/tested
between 4 sites
– Experience passed on to the GRIMOIRES OMII project.
– Support access to the NGS.
– Tied in with JISC VRE developments
Evaluations
–
–
–
–
Feedback & future requirements
UK
Campus
Operations and
other
Grids
Deployment/testing/advice
Stuff We Don’t Do
• Run a repository
• Develop software
– contribute to developments to influence/adapt
– Condor pools at 4 sites have been flocked together, through firewalls
– authentication through use of X.509 certifcates
– OMII test bed
• Portals
•
Software with proven
capability & realistic
deployment
experience
InnerGrid - Contractual issues delayed start - just started.
OMII – Start later this month
GT4 – Start later this month
gLite – start next month
One Stop Shop
cf
“I’ve got one of those you can have. You just need to …”
• (Training – Edinburgh/NeSC are part of
GOSC)
• Extensive user hand-holding and app support
– Need the e-Science Centres
– Priorities will be driven by users
Grid Operations Centre
Responsibilities in EGEE
UK focused screen
UKERNA work to be
integrated
Click for help
2
OMII
Authentication, authorisation, certificate management,
VO management, security.
Helpdesk
FAQ
LCG
GRIDPP
•Used for batch
production Now.
•
UK Contribution to LCG
•
GridPP1 (2001-2004)
•
GridPP2 (2004-2007)
– Also supports current users
– 33% deployment/operations
– 33% middleware dev.
– 33% applications
– 60% deployment/operations
• LCG2 -> EGEE
• worldwide de
facto standards
•Currently trying to
interface analysis S/W
•
• on top of gLite
from EGEE
– 15% middleware dev.
– 25% applications
Not just PPARC funding
– Universities
• support LHC
• benefit from grid experience
• You should know/meet these
people
•Need to move out of
the physics dept’s
NGS “Today”
Interfaces
•
•
Start from LCG2
“Harden” middleware
•
•
Expand applications
€32 from EU
•
–
–
–
The EU Grid Infrastructure
50% deployment/operations
lots at CERN
•
matched by PP
UK + I
–
–
–
training
GOC dev + ops
regional deployment+support
•
T2 coordinators
OGSI::Lite
Projects
e-Minerals
e-Materials
Orbital Dynamics of Galaxies
Bioinformatics (using BLAST)
GEODISE project
UKQCD Singlet meson project
Census data analysis
MIAKT project
e-HTPX project.
RealityGrid (chemistry)
WSRF::Lite
Users
Leeds
Oxford
UCL
Cardiff
Southampton
Imperial
Liverpool
Sheffield
Cambridge
Edinburgh
QUB
BBSRC
CCLRC.
3
“Tomorrow”
GOSC Timeline
NGS WS Service
NGS Expansion
(Bristol, Cardiff…)
NGS Production
Service
NGS WS Service 2
OGSA-DAI
NGS Expansion
WS plan
Q2
Q3
Q4
Q1
Q2
2004
WS2 plan
Q3
2005
Q4
Q1
Q2
Q3
2006
OMII release
gLite release 1
EGEE gLite alpha
release
Web Services
based
National Grid
Infrastructure
UofD
Commercial
Provider
PSRE
EGEE gLite release
OMII Release
U
of
A
H
P
C
x
Man. Leeds
GOSC
RAL
Oxford
C
S
A
R
U
of
B
U
of
C
NGS Core Nodes: Host core services, coordinate integration, deployment and support
+free to access resources for all VOs. Monitored interfaces + services
NGS Sites:
Integrated with NGS, some services/resources available for all VOs
Monitored interfaces + services
NGS Connected Sites: Integrated with NGS, support for some VO’s
Monitored interfaces (+security etc.)
UK e-Infrastructure
Users get common access, tools, information,
Nationally supported services, through NGS
Regional and
Campus grids
Integrated
internationally
SRB service
OGSA-DAI service
VRE, VLE, IE
LHC
ISIS TS2
HPCx + HECtoR
Production Status
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
TODAY
4 new core nodes operational
132 Users registered (32 since 1 September ’04)
Grid enabled – Globus v2 (VDT distribution v1.2) at present
BDII information service (GLUE + MDS Schemas)
Data Services – Oracle and SRB
Growing base of user applications
MyProxy and CA services provided by UK Grid Support Centre
VO Management Software – LCG-VO
User support: Helpdesk
Next…
Other Middleware [gLite/OMII etc…]
NGS Portal
Resource Broker
SRB pre-production service
User Example
GODIVA
Diagnostics Study of
Oceanography Data
EVE
Excitations and
Visualisation Project
Integrative Biology
Simulation of Strain in
Soft Tissue under Gravity
4
How do I Join as a New Site?
• Acceptable use and Security policies
• Install required interfaces (~EGEE)
– VDT
– EGEE CE and SE interfaces (and
Authorisation)
– Monitoring and accounting
• Provide services as defined in your own
SLD
– Buys you representation at the board (?)
Core services to facilitate collaborative (grid) computing – run by GOSC
UK e-Science Cert.
•Authentication (PKI X509)
gsi-ssh, globus-job-submit, condorG
•Job submission/batch service
EDG-RB
•Resource brokering
s
VOM/VOMS
•Authorisation
ce
rfa
•Virtual Organisation management VOMS (+Grid3/EGEE)
e
t
myProxy(++) in
•Certificate management
s
BDII/Glue
•Information service
ice
erv
•Data access/integration services (SRB/OGSA-DAI/DQPS)
S
•National Registry (of registry’s) e?bETF ?
W ? EGEE ?
•Data replication
? EGEE ?
•Data caching
EGEE/LCG + ETF +TeraGrid
•Grid monitoring
EGEE/LCG/ETF/GGF
•Accounting
Where Next?
• Make the NGS work
– Resource Broker/scheduler
– VO/Project support
– Monitoring and Accounting
• Compatibility with EGEE
• Define and agree criteria for success
• Web Services
Timeline
NGS WS Service
NGS Expansion
(Bristol, Cardiff…)
NGS Production
Service
NGS WS Service 2
OGSA-DAI
NGS Expansion
WS2 plan
WS plan
Q2
Q3
Q4
Q1
Q2
2004
Q3
2005
Q4
Q1
Q2
Q3
2006
OMII release
gLite release 1
• National e-Infrastructure
– Science and Innovation strategy 2004-2014
EGEE gLite alpha
release
EGEE gLite release
OMII Release
Summary
• We are in the game of providing a service
– built on leading edge academic stuff !
• The challenge
– not the latest and greatest grid
– not what any given user wants
• The solution
GOSC Director
Neil Geddes: n.i.geddes@rl.ac.uk
NGS Grid Coordinator
Andrew Richards: a.j.richards@rl.ac.uk
– want to make it work
• for our researchers
• for our institutions
– one site will not make a useful grid
• Sign people/users up (to the vision)
– “get out more”
Websites
http://www.grid-support.ac.uk
http://www.ngs.ac.uk
Helpdesk (via Grid Support Centre)
Email: support@grid-support.ac.uk
5
The End
6