http://www.grid-support.ac.uk
Mike Mineter mjm@nesc.ac.uk
http://www.ngs.ac.uk
http://www.nesc.ac.uk/ http://www.pparc.ac.uk/ http://www.eu-egee.org/
• Most slides are from GOSC / NGS:
– Stephen Pickles
– Neil Geddes
– Andy Richards
2
• Story so far
• The Grid Operations Support Centre
• Joining the NGS
• More training??!
• Information sources
3
• The National Grid Service is providing a production service
• It is a developing, dynamic service!
– Core services in place: data, computation, portal
– New middleware en route
– More sites joining
– International perspectives – EGEE, Teragrid
• Grid Operations Support Centre is poised to help you…
4
• Operating a production grid means valuing robustness and reliability over fashion.
• NGS cares about:
– alignment/compatibility with leading international Grid efforts
– special requirements of UK e-Science community
– easy migration/upgrade paths
– proven robustness/reliability
– based on standards or standards-track specifications
• NGS cannot support everything
• Everyone wants service-oriented grids
– but still settling out: WS-I, WS-I+, OGSI, WSRF, GT3, GT4, gLite
• Caution over OGSI/WSRF has led to wide convergence on GT2 for production grids and hence some inter-Grid compatibility
5
The Grid Operations Support Centre is a distributed “virtual centre” providing deployment and operations support for the UK e-Science programme.
6
USERS
Development
Manager
ETF
Steering Committee
Director
GOSC
Management Board
Operations Manager/
Technical Director
Audit Board
TRAINING
Networking
Security NGS GOC GSC
7
8
UK Grid Services
National Services
Authentication, authorization, certificate management, VO management, security, network monitoring, help desk + support centre.
support@grid-support.ac.uk
NGS Services
Job submission, simple registry, data transfer, data access and integration, resource brokering, monitoring and accounting, grid management services, workflow, notification, operations centre.
NGS core-node Services
CPU, (meta-) data storage, key software
Services coordinated with others (eg OMII, NeSC, LCG):
Integration testing, compatibility & Validation Tests, User Management, training
Administration:
Policies and acceptable use conditions
SLA’s, SLD’s
Coordinate deployment and Operations
9
• Access Grid
•
Certification
• Condor
• ETF
•
For Information
• General
• GT2
• GT3
• GT4
•
Globus-MDS
• GridFTP
• Internal
•
Maillist
• Myproxy
• NGS
•
OGSA-DAI
• Project Registration
• RA
• Security
• SRB
•
Support Notices
• Training
•
Unicore
10
• As
– Users
– Projects
– Resource providers
11
• Want access to Grid-enabled compute and/or data resources?
• Willing to pay the price of admission?
– all access via UK e-Science certificates
• Can use the middleware already provided?
– if you need something else, please say!
12
• You need a current UK e-Science Certificate
– http://ca.grid-support.ac.uk/
– See your local Registration Authority
• Complete the application form on the NGS web site, and read the conditions of use:
– http://www.ngs.ac.uk/apply.html
• Wait 1-2 weeks for peer review
• You gain access to all core nodes automatically
• Contact GOSC to gain access to OGSA-DAI and Oracle
• Use the NGS and GSC web sites and help-desk
• Happy computing!
13
User Applies
(Via Website)
Accepted
(User Notified)
Application QC
User added to NGS VO
(includes SRB account)
Application Submitted to Peer Review Panel
User added
NGS-USER and
NGS-ANNOUNCE
Mailing lists
Approved ?
Rejected
(User Notified)
14
• Apply, using e-science certificate
• Your SRB name is defined by the NGS
– Additional password for Windows client to SRB
• Follow pages from http://www.ngs.ac.uk
15
• Just need access to compute and data resources for users in your project?
– short term, we need applications from individuals
– project-based applications will come, currently in requirements gathering phase
– if in doubt, talk to us!
• Want to host your data on NGS?
– consider GridFTP, SRB, Oracle, or OGSA-DAI
– NGS maintains infrastructure
– you populate and manage data
– for OGSA-DAI, work with NGS to validate Grid Data Services
• Want to use NGS resources to provision services, portals for a community of users?
– next slide
16
• NGS resources can be used to provide a portal or other service for your community
• Deployment and security scenarios are negotiable
• NGS policies (core nodes):
– your portal can present its own, or a delegated user’s credential to NGS, but tasks should be traceable to initiating end-user
– you should not run your own services in user space without prior agreement of NGS and hosting site
• we need to know that services are secure, will not jeopardise operation of other NGS services, or consume too much precious resource on head nodes
• Talk to GOSC!
17
Resource providers join the NGS by
• Defining level of service commitments
• Adopting NGS acceptable use and security policies
• Run compatible middleware
– as defined by NGS Minimum Software Stack
– and verified by compliance test suite
• Support monitoring and accounting
Two levels of membership
1. Affiliates run compatible stack, integrated support
2.
Partners also contribute “significant resources”
18
Affiliates commit to:
• running NGS-compatible middleware
– as defined in NGS Minimum Software Stack
– this means users of affiliate’s resources can access these using same client tools they use to access NGS
• a well-defined level of service and problem referral mechanisms
– SLD approved by NGS Management Board and published on NGS web-site
• providing technical, administrative, and security (CERT) contacts
• providing an account and mapping for daily compliance tests
(GITS++)
• accepting UK e-Science certificates
• maintaining baseline of logs to assist problem resolution
19
Partners commit to same as affiliates, plus:
• making “significant” resources available to NGS users
– creation of accounts/mappings
– in future, VO support, pool accounts, etc
• recognise additional CAs with which UK e-Science programme has reciprocal agreements
• publish/provide additional information to support resource discovery, brokering
• ability to compile code for computational resources
Bristol and Cardiff going through certification process now.
• supported by “buddies” and NGS-Rollout list
• useful feedback on viability of NGS Minimum Software Stack
20
• 31 March: Creating the UI environment
• Watch http://www.nesc.ac.uk/training
• Also
• Globus Week, NeSC : 4-8 April via http://www.nesc.ac.uk/esi/esi.html
• http://egee.nesc.ac.uk/ for EGEE events and materials – repository.
• By the way:
– Next run of this course 29-30 March: check what changes!
– Give us your feedback!! Now and in future if you find something we should have covered.
• TELL US WHAT YOU WANT FOR TRAINING !!!!
21
• Establishing set of core courses:
– Induction, sysadmin, application devel.,…
• For EGEE (current and gLite), NGS
• Cooperating with OMII
– Fundamentals: WS, WS-RF
• In NeSC national role:
– Will be building collaborations to support/co-deliver training with UK escience centres and VO’s
– Establishing repository and website http://www.nesc.ac.uk/training
• In regional role: supporting
22
23
EGEE www.eu-egee.org
Training activity homepage : http://egee.nesc.ac.uk/
Roadmap : training events since the start of EGEE http://www.egee.nesc.ac.uk/schedreg/index.html
LCG lcg.web.cern.ch/LCG/
NeSC www.nesc.ac.uk
The Grid Cafe www.gridcafe.org
• More EU sites :
• http://www.cordis.lu/ist/grids/fp6_grid_projects.htm
• http://www.gridstart.org/concertation_mtg.shtml
• “Concertation event” and EGEE conference http://public.eu-egee.org/conferences/2nd/programme/outline.html
• e-Infrastructures Reflection Group http://www.e-irg.org
24
• National Grid Service http://www.ngs.ac.uk
• Grid Operations Support Centre http://www.grid-support.ac.uk
• National e-Science Centre http://www.nesc.ac.uk
• UK Training Roadmap http://www.nesc.ac.uk/training
• ALSO: regional centres, centres of excellence and
NIEeS, NCeSS
• UK AHM
– 2004: http://www.allhands.org.uk/programme/programme.html
– 2005: http://www.allhands.org.uk/
25
26
• Is providing a production service
• Currently has core resources, procedures and operations in place
• Is developing and expanding
– Both organisationally and in middleware
• Is a “SERVICE”
– Organised to respond to your requirements!!!
– What do YOU want of the NGS?
• Tell GOSC !
• GOSC: exists to support you!!!
27
• Last chance for questions… and feedback.
28