Enabling Grids for E-sciencE
EGEE and
the National Grid Service
Mike Mineter
mjm@nesc.ac.uk
www.eu-egee.org
INFSO-RI-508833
Acknowledgements
Enabling Grids for E-sciencE
• This talk was prepared by Mike Mineter of NeSC and
includes slides from talks delivered by:
– Neil Geddes, GOSC Face-to-Face, NeSC, November 2004
– Andy Richards, GOSC Face-to-Face, NeSC, November 2004
– Tony Hey, AHM 2004, Nottingham,
http://www.allhands.org.uk/programme/programme.html
INFSO-RI-508833
EGEE and the National Grid Service
EGEE Induction, 8 December 2004, NeSC
2
Goals of this module
Enabling Grids for E-sciencE
• To outline the National Grid Service
• To summarise its relationship with EGEE
INFSO-RI-508833
EGEE and the National Grid Service
EGEE Induction, 8 December 2004, NeSC
3
Contents
Enabling Grids for E-sciencE
• Snapshots of the UK e-infrastructure
• The UK e-Science programme
• The National Grid Service
• The NGS and EGEE
INFSO-RI-508833
EGEE and the National Grid Service
EGEE Induction, 8 December 2004, NeSC
4
Snapshots of UK e-infrastructure
Enabling Grids for E-sciencE
• The JISC view
• Digital curation
• Networks
– We’ve been (mainly) ignoring networks today!
– A sign of their success!!
• Grids
INFSO-RI-508833
EGEE and the National Grid Service
EGEE Induction, 8 December 2004, NeSC
5
• E-research
Portals
Applications
Content
Meta Data &
Delivery tools
• Finding /Access
tools
• Digital libraries
•
•
•
•
• E-learning
The JISC Communities
• AAA Services
• Internet
6
Digital Curation Centre
• Actions needed to maintain and utilise digital
data and research results over entire lifecycle
– For current and future generations of users
• Digital Preservation
– Long-run technological/legal accessibility and
usability
• Data curation in science
– Maintenance of body of trusted data to represent
current state of knowledge in area of research
• Research in tools and technologies
– Integration, annotation, provenance, metadata,
7
Communicating across 3 dimensions:
Enabling Grids for E-sciencE
• Space and organisational boundaries: Grids
• Time : curation
• Domains of knowledge: semantics
• (With thanks to Peter Burnhill, EDINA)
INFSO-RI-508833
EGEE and the National Grid Service
EGEE Induction, 8 December 2004, NeSC
8
Snapshots of UK e-infrastructure
Enabling Grids for E-sciencE
• The JISC view
• Digital curation
• Networks
– We’ve been (mainly) ignoring networks today!
– A sign of success!!
• Grids
INFSO-RI-508833
EGEE and the National Grid Service
EGEE Induction, 8 December 2004, NeSC
9
Local Research
Equipment
UK Researchers
International
Point-of-Access
Extended JANET
Development Network
Existing
connections
Proposed
connections
CA*net
StarLight
Chicago
UKLight
London
10Gb/s
2.5Gb/s
10Gb/s
Abilene
10Gb/s
CERN
10Gb/s
10Gb/s
NetherLight
Amsterdam
JISC £6.5M for UKLight
‘Lambda’ Network
CzechLight
GEANT
10
Snapshots of UK e-infrastructure
Enabling Grids for E-sciencE
• The JISC view
• Digital curation
• Networks
– We’ve been (mainly) ignoring networks today!
– A sign of success!!
• Grids
INFSO-RI-508833
EGEE and the National Grid Service
EGEE Induction, 8 December 2004, NeSC
11
The UK e-Science programme
Enabling Grids for E-sciencE
• Goal
• Where we are today
• Web services and Grids
INFSO-RI-508833
EGEE and the National Grid Service
EGEE Induction, 8 December 2004, NeSC
12
The UK e-Science programme
Enabling Grids for E-sciencE
• “We are attempting to build an infrastructure
comprised of a set of middleware services capable of
supporting the dynamic 'virtual organisations' required
by scientists, engineers and industry. As a shorthand
for this core middleware infrastructure I often use the
controversial term ‘Grid’”
Professor Tony Hey, September 2004
• £250M UK e-Science Initiative
INFSO-RI-508833
EGEE and the National Grid Service
EGEE Induction, 8 December 2004, NeSC
13
UK Core e-Science programme Situation Today
Enabling Grids for E-sciencE
Level-2 Grid
http://www.grid-support.ac.uk/l2g/
National Grid Service
* Leeds
Manchester *
* DL
* Oxford
RAL *
INFSO-RI-508833
EGEE and the National Grid Service
EGEE Induction, 8 December 2004, NeSC
14
Web Services and Grids
• Computing models developed for sequential
machines led to the distributed object model of
distributed computing represented by Java and
CORBA
• Experience has shown that the distributed object
model ties distributed entities together too tightly
• Resulted in ‘fragile’ distributed software systems
when going from LANs to WANs
 Replace distributed objects by ‘services’
connected by “one-way” messages and not by
request-response messages
 IT industry has ‘united’ around Web Services
Tony Hey, AHM 2004
http://www.allhands.org.uk/programme/programme.html
15
The Web Services ‘Magic Bullet’
Company A
(J2EE)
Web services
Company B
(ONE)
Company C
(.Net)
Tony Hey, AHM 2004
http://www.allhands.org.uk/programme/programme.html
16
Web Service Grids:
An Evolutionary Approach
Specifications that have/will enter a standardisation process
but are not stable and are still experimental
‘WS-I+’
profile
WS-I
Standards that have
broad industry support
Specifications that are emerging
and multiple interoperable
from standardisation process
Tony Hey, AHM 2004
http://www.allhands.org.uk/programme/programme.html
implementations
17
and are recognised
as being
‘useful’
WS-I+ Grid Interoperability Profile
• WS-I identifies XSD, WSDL, SOAP, UDDI
• WS-I+ adds minimum additional capabilities to WSI to allow development of Grid Services
– BPEL and extensions for scientific workflows
– WS-Addressing for virtualization of messaging
– WS-ReliableMessaging/Reliability to provide basis for
fault tolerant and efficient Grid services
• Expect progress in
– WS-ResourceFramework – submitted to OASIS
– Notification – dialogue between IT companies
– Security – need to understand better relationship of Web
Services and Grid approaches
Tony Hey, AHM 2004
http://www.allhands.org.uk/programme/programme.html
18
– Portlets
– generic
toolkit for portal construction
The NGS and GOSC
Enabling Grids for E-sciencE
• The NGS is the core UK grid, intended for the production use of
computational and data grid resources. NGS is the core service
resulting from the UK's e-Science programme. NGS is supported
by JISC, and is run by the Grid Operations Centre (GOC).
• http://www.ngs.ac.uk/
• The UK Grid Operations Support Centre is a distributed "virtual
centre" providing deployment and operations support for the UK
e-Science programme. The core of the GOSC is built around
operation of the National Grid Service (NGS). The GOSC will
support UK services for user authentication, user authorization
and project organization, credential management, resource
discovery, access portal and more, to be driven by the user
requirements.
• http://www.grid-support.ac.uk/
INFSO-RI-508833
EGEE and the National Grid Service
EGEE Induction, 8 December 2004, NeSC
19
Enabling Grids for E-sciencE
UK e-Infrastructure
Users get common access, tools, information,
Nationally supported services, through NGS
Regional and
Campus grids
Integrated
internationally
VRE, VLE, IE
LHC
INFSO-RI-508833
ISIS TS2
EGEE and the National Grid Service
HPCx + HECtoR
EGEE Induction, 8 December 2004, NeSC
20
UofD
U
of
A
H
P
C
x
Commercial
Provider
PSRE
Man. Leeds
GOSC
RAL
Oxford
C
S
A
R
U
of
B
U
of
C
NGS Core Nodes: Host core services, coordinate integration, deployment and support
+free to access resources for all VOs. Monitored interfaces + services
NGS Sites:
Integrated with NGS, some services/resources available for all VOs
Monitored interfaces + services
NGS Connected Sites: Integrated with NGS, support for some VO’s
Monitored interfaces (+security etc.)
NGS Hardware
Enabling Grids for E-sciencE
Compute Cluster
Data Cluster
•64 dual CPU Intel 3.06 •20 dual CPU Intel 3.06
GHz (1MB cache)
GHz nodes
nodes
•18TB Fibre SAN (
Infortrend F16F 4.1TB
Fibre Arrays (UltraStar
146Z10 disks)
•Oracle 9i RAC
•Oracle Application
server
INFSO-RI-508833
EGEE and the National Grid Service
EGEE Induction, 8 December 2004, NeSC
22
NGS Middleware
Enabling Grids for E-sciencE
• Core NGS
– VDT (Globus 2) Middleware
– OGSA-DAI implementation (pre-production)
– Data Services – Oracle, SRB
– Various Applications…
• GOSC – GSC Supported services for the NGS
– MyProxy Service – myproxy.grid-support.ac.uk
– BDII / MDS Information Service (Production and
Development)
– VOM (LCG-VO) Service
– Monitoring tools
• GOSC (GSC, NGS) Developing expertise with EGEE
software / middleware – resource broker – and testing
gLite
INFSO-RI-508833
EGEE and the National Grid Service
EGEE Induction, 8 December 2004, NeSC
23
“Tomorrow”
Enabling Grids for E-sciencE
GOSC Timeline
NGS WS Service
NGS Expansion
(Bristol, Cardiff…)
NGS Production
Service
NGS WS Service 2
OGSA-DAI
NGS Expansion
WS2 plan
WS plan
Q2
Q3
Q4
Q1
2004
Q2
Q3
Q4
Q1
Q2
OMII release
gLite release 1
EGEE gLite alpha
release
INFSO-RI-508833
Q3
2006
2005
Web Services
based
National Grid
Infrastructure
EGEE gLite release
OMII Release
EGEE and the National Grid Service
EGEE Induction, 8 December 2004, NeSC
24
Summary
Enabling Grids for E-sciencE
• e-infrastructure is being developed and used to
support knowledge creation (research), curation, and
dissemination
• In the UK, the National Grid Service provides the
middleware services that uses the network
infrastructure and enables application services
(computation, data, collaboration,…)
• NGS will interoperate with EGEE
• Grid Operations Support Centre is the initial source for
further information http://www.grid-support.ac.uk/
INFSO-RI-508833
EGEE and the National Grid Service
EGEE Induction, 8 December 2004, NeSC
25