Next Steps Mike Mineter

advertisement

http://www.grid-support.ac.uk

Next Steps

Mike Mineter mjm@nesc.ac.uk

http://www.ngs.ac.uk

http://www.nesc.ac.uk/ http://www.pparc.ac.uk/ http://www.eu-egee.org/

Acknowledgements

• Most slides are from GOSC / NGS:

– Stephen Pickles

– Neil Geddes

– Andy Richards

2

Overview

• Story so far

• The Grid Operations Support Centre

• Joining the NGS

• More training??!

• Information sources

3

The story so far

• The National Grid Service is providing a production service

• It is a developing, dynamic service!

– Core services in place: data, computation, portal

– New middleware en route

– More sites joining

– International perspectives – EGEE, Teragrid

• Grid Operations Support Centre is poised to help you…

4

NGS- Production service

• Operating a production grid means valuing robustness and reliability over fashion.

• NGS cares about:

– alignment/compatibility with leading international Grid efforts

– special requirements of UK e-Science community

– easy migration/upgrade paths

– proven robustness/reliability

– based on standards or standards-track specifications

• NGS cannot support everything

• Everyone wants service-oriented grids

– but still settling out: WS-I, WS-I+, OGSI, WSRF, GT3, GT4, gLite

• Caution over OGSI/WSRF has led to wide convergence on GT2 for production grids and hence some inter-Grid compatibility

5

GOSC

The Grid Operations Support Centre is a distributed “virtual centre” providing deployment and operations support for the UK e-Science programme.

6

USERS

Development

Manager

ETF

Steering Committee

Director

GOSC

Management Board

Operations Manager/

Technical Director

Audit Board

TRAINING

Networking

Security NGS GOC GSC

7

8

GOSC Roles

 UK Grid Services

National Services

 Authentication, authorization, certificate management, VO management, security, network monitoring, help desk + support centre.

 support@grid-support.ac.uk

NGS Services

 Job submission, simple registry, data transfer, data access and integration, resource brokering, monitoring and accounting, grid management services, workflow, notification, operations centre.

NGS core-node Services

 CPU, (meta-) data storage, key software

Services coordinated with others (eg OMII, NeSC, LCG):

 Integration testing, compatibility & Validation Tests, User Management, training

 Administration:

Policies and acceptable use conditions

SLA’s, SLD’s

Coordinate deployment and Operations

9

• Access Grid

Certification

• Condor

• ETF

For Information

• General

• GT2

• GT3

• GT4

Globus-MDS

• GridFTP

• Internal

Maillist

• Myproxy

• NGS

OGSA-DAI

• Project Registration

• RA

• Security

• SRB

Support Notices

• Training

Unicore

10

Joining the NGS

• As

– Users

– Projects

– Resource providers

11

End-users

• Want access to Grid-enabled compute and/or data resources?

• Willing to pay the price of admission?

– all access via UK e-Science certificates

• Can use the middleware already provided?

– if you need something else, please say!

12

End-users: what to do

• You need a current UK e-Science Certificate

– http://ca.grid-support.ac.uk/

– See your local Registration Authority

• Complete the application form on the NGS web site, and read the conditions of use:

– http://www.ngs.ac.uk/apply.html

• Wait 1-2 weeks for peer review

• You gain access to all core nodes automatically

• Contact GOSC to gain access to OGSA-DAI and Oracle

• Use the NGS and GSC web sites and help-desk

• Happy computing!

13

User Registration (Process)

User Applies

(Via Website)

Accepted

(User Notified)

Application QC

User added to NGS VO

(includes SRB account)

Application Submitted to Peer Review Panel

User added

NGS-USER and

NGS-ANNOUNCE

Mailing lists

Approved ?

Rejected

(User Notified)

14

Registration

• Apply, using e-science certificate

• Your SRB name is defined by the NGS

– Additional password for Windows client to SRB

• Follow pages from http://www.ngs.ac.uk

15

Projects and VOs

• Just need access to compute and data resources for users in your project?

– short term, we need applications from individuals

– project-based applications will come, currently in requirements gathering phase

– if in doubt, talk to us!

• Want to host your data on NGS?

– consider GridFTP, SRB, Oracle, or OGSA-DAI

– NGS maintains infrastructure

– you populate and manage data

– for OGSA-DAI, work with NGS to validate Grid Data Services

• Want to use NGS resources to provision services, portals for a community of users?

– next slide

16

Providing services for a

VO

• NGS resources can be used to provide a portal or other service for your community

• Deployment and security scenarios are negotiable

• NGS policies (core nodes):

– your portal can present its own, or a delegated user’s credential to NGS, but tasks should be traceable to initiating end-user

– you should not run your own services in user space without prior agreement of NGS and hosting site

• we need to know that services are secure, will not jeopardise operation of other NGS services, or consume too much precious resource on head nodes

• Talk to GOSC!

17

Expansion

Resource providers join the NGS by

• Defining level of service commitments

• Adopting NGS acceptable use and security policies

• Run compatible middleware

– as defined by NGS Minimum Software Stack

– and verified by compliance test suite

• Support monitoring and accounting

Two levels of membership

1. Affiliates run compatible stack, integrated support

2.

Partners also contribute “significant resources”

18

Affiliation

Affiliates commit to:

• running NGS-compatible middleware

– as defined in NGS Minimum Software Stack

– this means users of affiliate’s resources can access these using same client tools they use to access NGS

• a well-defined level of service and problem referral mechanisms

– SLD approved by NGS Management Board and published on NGS web-site

• providing technical, administrative, and security (CERT) contacts

• providing an account and mapping for daily compliance tests

(GITS++)

• accepting UK e-Science certificates

• maintaining baseline of logs to assist problem resolution

19

Partnership

Partners commit to same as affiliates, plus:

• making “significant” resources available to NGS users

– creation of accounts/mappings

– in future, VO support, pool accounts, etc

• recognise additional CAs with which UK e-Science programme has reciprocal agreements

• publish/provide additional information to support resource discovery, brokering

• ability to compile code for computational resources

Bristol and Cardiff going through certification process now.

• supported by “buddies” and NGS-Rollout list

• useful feedback on viability of NGS Minimum Software Stack

20

More training?

• 31 March: Creating the UI environment

• Watch http://www.nesc.ac.uk/training

• Also

• Globus Week, NeSC : 4-8 April via http://www.nesc.ac.uk/esi/esi.html

• http://egee.nesc.ac.uk/ for EGEE events and materials – repository.

• By the way:

– Next run of this course 29-30 March: check what changes!

– Give us your feedback!! Now and in future if you find something we should have covered.

• TELL US WHAT YOU WANT FOR TRAINING !!!!

21

NeSC UK Training

• Establishing set of core courses:

– Induction, sysadmin, application devel.,…

• For EGEE (current and gLite), NGS

• Cooperating with OMII

– Fundamentals: WS, WS-RF

• In NeSC national role:

– Will be building collaborations to support/co-deliver training with UK escience centres and VO’s

– Establishing repository and website http://www.nesc.ac.uk/training

• In regional role: supporting

22

Information Sources

23

EU WEB SITES

EGEE www.eu-egee.org

Training activity homepage : http://egee.nesc.ac.uk/

Roadmap : training events since the start of EGEE http://www.egee.nesc.ac.uk/schedreg/index.html

LCG lcg.web.cern.ch/LCG/

NeSC www.nesc.ac.uk

The Grid Cafe www.gridcafe.org

• More EU sites :

• http://www.cordis.lu/ist/grids/fp6_grid_projects.htm

• http://www.gridstart.org/concertation_mtg.shtml

• “Concertation event” and EGEE conference http://public.eu-egee.org/conferences/2nd/programme/outline.html

• e-Infrastructures Reflection Group http://www.e-irg.org

24

UK resources

• National Grid Service http://www.ngs.ac.uk

• Grid Operations Support Centre http://www.grid-support.ac.uk

• National e-Science Centre http://www.nesc.ac.uk

• UK Training Roadmap http://www.nesc.ac.uk/training

• ALSO: regional centres, centres of excellence and

NIEeS, NCeSS

• UK AHM

– 2004: http://www.allhands.org.uk/programme/programme.html

– 2005: http://www.allhands.org.uk/

25

And finally….

26

The NGS

• Is providing a production service

• Currently has core resources, procedures and operations in place

• Is developing and expanding

– Both organisationally and in middleware

• Is a “SERVICE”

– Organised to respond to your requirements!!!

– What do YOU want of the NGS?

• Tell GOSC !

• GOSC: exists to support you!!!

27

• Last chance for questions… and feedback.

28

Download