UK Grid Operations Support Centre
Dr Neil Geddes
CCLRC Head of e-Science
Director of the UK Grid Operations Support Centre
UK Core e-Science programme Situation Today
National Grid Service
Level-2 Grid
* Leeds
Manchester *
* DL
RAL ** Oxford
The Future According to Hey
N
G
S
UK Grid Operations
Support Centre
Steering Committee
Steering Committee
Audit Board
Audit Board
Funding bodies + stake-holders
Independent body
(JISC, RC’s, users, res. providers)
Director
Management
Board
withprogramme
SC
Director,Agreed
UK e-Science
(Chair)
GOSC
JISC Reviews progress
RCUK
and Policy
performance
Sets and
Coordinates
UCISA.
Decides
on against
services
etc. criteria
UK e-Science
TABagreed
rep.?
(bi)Annual
UK eSSC
rep?
Management Board
Resource Providers (Management Board) Rep
USERS
Director, GOSC (Chair)
Director, GOSC.
GOSC User
Technical
Director
Group Chair
ETF ChairBoard
Operations
Operations Manager/
GridPP Project Leader
Technical Director
OMII Director
Organises
running
NeSCday-to-day
Director
EGEE UK+I Federation Leader
NGS coordinator
Operations
Board User Board Chair.
TRAINING
e-Science
Site reps
UKERNA
Security/CERT rep
Resource Providers
GSC
Development
Manager
ETF
( Initiallly 1 per GOSC Institution
GOC - CCLRC, Leeds, Oxford, Manchester, Edinburgh- .
Networking
rep. expect to move to a “Regional”
Eventually
e.g. MAN representation model.? )
Networking
Security
NGS/Core
GOC
GSC
GOSC Roles
{
UK Grid Services
{
{
{
{
Coordinate deployment and Operations
{
{
{
Core UK Grid services: Simple Registry, data
transfer, Job Submission, security, Data Access
Key services (to be supported for all Grids):
Authorisation, Notification, Workflow, Monitoring and
Accounting, Grid Management Services, VO support
Services to be coordinated with others (eg OMII,
NeSC, LCG): Integration testing, compatibility &
Validation Tests, User Management, training
Decide what and when
Monitoring of interfaces and SLD’s
Helpdesk
GOSC + ETF
•
Core of GOSC built around experience in deploying and running National
Grid Service (NGS)
– Support service
•
Important to coordinate and integrate this with deployment and operations
work in EGEE, LCG and similar projects.
– e.g. EGEE – low level services, CA, GOC, CERT...
•
Focus on deployment and operations, NOT development.
EGEE…
Other software
sources
Prototypes &
specifications
NGS
ETF
Software with proven
capability & realistic
deployment
experience
OMII
‘Gold’ services
Feedback & future requirements
Deployment/testing/advice
UK
Campus
Operations and
other
Grids
The OMII, ETF & NGS in
context
Software with proven
Other Software Services
capability & realistic
deployment experience
EGEE
NMI
???
‘Gold’ Services
NGS
ETF
OMII
Prototypes &
Specifications
Feedback &
future requirements
The UK’s National Grid Service
UofD
U
of
A
H
P
C
x
Commercial
Provider
PSRE
Man. Leeds
GOSC
RAL
Oxford
C
S
A
R
U
of
B
U
of
C
NGS Core Nodes: Host core services, coordinate integration, deployment and support
+free to access resources for all VOs. Monitored interfaces + services
NGS Sites:
Integrated with NGS, some services/resources available for all VOs
Monitored interfaces + services
NGS Connected Sites: Integrated with NGS, support for some VO’s
Monitored interfaces (+security etc.)
How do I Join ?
• Acceptable use and Security policies
• Install required interfaces (~EGEE)
– VDT
– EGEE CE and SE (and Authorisation)
– Monitoring and accounting
• Provide services as defined in your own
SLD
– Buys you representation at the board
Core services to facilitate collaborative (grid) computing
UK e-Science Cert.
•Authentication (PKI X509)
gsi-ssh, globus-job-submit, condorG
•Job submission/batch service
EDG-RB
•Resource brokering
VIM/VOMS (+work Manchester/EGEE)
•Authorisation
•Virtual Organisation management VOMS (+Grid3/EGEE/Manchester)
myProxy(++)
•Certificate management
BDII/Glue
•Information service
•Data access/integration services (SRB/OGSA-DAI/DQPS)
? ETF ?
•National Registry (of registry’s)
? EGEE ?
•Data replication
? EGEE ?
•Data caching
EGEE/LCG + ETF (+TeraGrid)
•Grid monitoring
? EGEE/LCG/ETF ?
•Accounting
ETF
•
•
•
•
Deploy/test Grid Systems
Deploy/test EGEE
Deploy/test OMII
Deploy/test other solutions required by NGS
– fill holes in collaboration with other projects…
• Portal
• Authorisation developments
• Accounting
Compatibility?
NGS focus will be on stable supported services
and planned developments.
• EGEE
• Linux RH Enterprise 3.x-based systems are the most widely
accepted by the sites (see results of SA1 platform survey).
No flavor of it (RHEL30, Scientific Linux, CEL3, Fermi Linux,
etc) will be enforced / recommended.
• Windows provides second certified system
• OMII
• Not yet known – expect Tomcat Axis
• Developments in AAA are challenging at present
• stay where we are (GSI) until we have a solution
Stuff We Don’t Do
• Run a repository
• Develop software
– contribute to developments to influence/adapt cf
“I’ve got one of those you can have. You just need to …”
• (Training – Edinburgh/NeSC are part of GOSC)
• Extensive user hand-holding and app support
– Need the e-Science Centres
– Priorities will be driven by users
Stuff we haven’t worked out yet
• What is a “Data Service”
– and how do we fund/support it
• What about demands which conflict
– Versions of Apache
– Alternative versions of (core) services
• If it aint better, why would be want it ?
– Upgrades
• Focus on the services rather than the hardware
• Test beds and development systems
GOSC Timeline
NGS WS Service
NGS Expansion
(Bristol, Cardiff…)
NGS Production
Service
NGS WS Service 2
OGSA-DAI
NGS Expansion
WS2 plan
WS plan
Q2
Q3
Q4
Q1
Q2
2004
Q3
2005
Q4
Q1
Q2
2006
OMII release
Gridlite release 1
EGEE gLite alpha
release
Q3
EGEE gLlite release
OMII Release
Areas of Concern
• CA
–
–
–
–
Minimal support
Decaying
No plan from JISC – or anyone else
Are we serious about authenticated certificates?
• Security
– Operational procedures etc.
• Yesterdays excitement
– Increasing visibility of grid system
• TeraGrid and NorduGrid
JISC VRE
• Opportunity for user/community solutions
on NGS
– EGEE gLite,
• gLite software available from ~September
• Deploy in biomedical project ??
– Town meeting on July 19
– Similarly for OMII and GT4
SR2004: Combined OST/JISC Bid
Core Programme Activity post 2006
•
•
•
•
•
GOSC and NGS
OMII and Calls
e-SI and Centres
DCC
Standards
£3.0M
£5.0M
£1.0M
£1.5M
£0.5M
Infrastructure Total
£11.0M per annum
+ HECtoR + GridPP + regional grids + DTI/TP +
Concluding Remarks
• We need to make it happen
– Commitment to shared infrastructure vision
– Planning and scheduling important
– Engage with others
• We need users
• Leverage large EU investment
• It will happen…
“Due to the potential importance of a national e-infrastructure to the needs of the research base
and its supporting infrastructure in meeting the Government’s broader science and
innovation goals, as a first step OST will take a lead in taking forward discussion and
development of proposals for action and funding, drawing in other funders and stakeholders
as necessary.” – Science and Innovation Investment Framework 2004-2014.