Enabling Grids for eScience in Europe
(EGEE)
Mike Mineter
Guy Warner
http://egee-intranet.web.cern.ch
Acknowledgements
• Slides on EU e-infrastructure derived from ones used by Bernhard
Fabianek, European Commission, Information Society DirectorateGeneral at the EOGEO conference, University College London, June
2004.
• Sites in LCG-2/EGEE-0 slide taken from GGF talk by Malcolm Atkinson
and Ian Bird; see also
http://goc.gridsupport.ac.uk/gppmonWorld/gppmon_maps/CERN_lxn1188.html
• Job submission slides taken from European DataGrid tutorial,
developed by the EDG training team.
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 2
Outline
• Overview of EGEE, FP 6 project funded by EU
Mike Mineter mjm@nesc.ac.uk
ƒ Vision: an Europe-wide e-Infrastructure
ƒ EGEE goal: delivery of a production Grid service
ƒ Current components
• Current demonstration system
Guy Warner gcw@nesc.ac.uk
ƒ GILDA, hosted by INFN and University of Catania
ƒ GENIUS portal
ƒ Example application
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 3
Vision: a Europe-wide e-Infrastructure
• Empowering and stimulating collaboration
ƒ Internationally
ƒ Across research, public sector, commerce
• Integrating data, computation, knowledge
ƒ Between researchers, experts, stake-holders and decision-makers
• Building on
ƒ National Infrastructures – NREN’s, Geant and Grids
ƒ Emerging technologies
• Powerful instrument for international cooperation
ƒ … cohesion, cooperation, standards, industry, etc…
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 4
Enabling Grids for eScience in Europe
EGEE
Multiple VO’s
Pan-European
production Grid
Network
infrastructure
EGEE
Grid
T
AN
É
G
.
slide modified from EOGEO conference talk by Bernhard Fabianek, European
Commission, Information Society Directorate-General
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 5
EGEE Project Structure
24% Joint Research
28% Networking
JRA1: Middleware Engineering
and Integration - 17%
NA1: Management
NA2: Dissemination and Outreach
NA3: User Training and Education
NA4: Application Identification and
Support
NA5: Policy and International
Cooperation
JRA2: Quality Assurance - 1.5%
JRA3: Security - 3%
JRA4: Network Services
Development - 2.5%
48% Services
SA1: Grid Operations, Support and Management
SA2: Network Resource Provision
Emphasis in EGEE is on
operating a production
grid and supporting the endusers
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 6
EGEE will:
• Establish production quality
sustained Grid services
ƒ
5000 users after 4 yrs (3000
after year 2) from at least 5
disciplines
ƒ over 20,000 CPU's
ƒ 70 institutions in 28 countries.
•
Demonstrate a viable general
process to bring other scientific
communities on board
•
Spend 32 Million Euros over 2
years starting 1st April 2004
•
Propose a second phase in mid
2005 to take over EGEE in early
2006
Initial domains
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 7
Outline
• Overview of EGEE, FP 6 project funded by EU
ƒ Vision: an Europe-wide e-Infrastructure
ƒ Goal: delivery of a production Grid service
ƒ Current EGEE-0 service
• Current demonstration system
ƒ GILDA, hosted by INFN and University of Catania
ƒ GENIUS portal
ƒ Example application
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 8
Sites in LCG-2/EGEE-0 : June 4
2004
Austria
U-Innsbruck
Canada
Triumf
Alberta
Carleton
Montreal
Toronto
Italy
CNAF
Frascati
Legnaro
Milano
Napoli
Roma
Torino
Czech
Republic
Prague-FZU
Prague-CESNET
Japan
Tokyo
Netherlands
NIKHEF
France
CC-IN2P3
Clermont-Ferrand
Pakistan
NCP
Germany
FZK
Aachen
DESY
Wuppertal
Poland
Krakow
Portugal
LIP
Russia
SINP-Moscow
JINR-Dubna
Spain
PIC
UAM
USC
UB-Barcelona
IFCA
CIEMAT
IFIC
Greece
HellasGrid
Hungary
Budapest
India
TIFR
Israel
Tel-Aviv
Weizmann
Switzerland
CERN
CSCS
Taiwan
ASCC
NCU
UK
RAL
Birmingham
Cavendish
Glasgow
Imperial
Lancaster
Manchester
QMUL
RAL-PP
Sheffield
UCL
US
BNL
FNAL
HP
Puerto-Rico
• 22 Countries
• 58 Sites (45 Europe, 2 US, 5 Canada, 5 Asia, 1 HP)
• Coming: New Zealand, China,
other HP (Brazil, Singapore)
• 3800 cpu
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 9
The lifecycle of an EGEE job
UI
JDL
Replica
Catalogue
Input “sandbox”
DataSets info
Information
Service
Output “sandbox”
Expanded JDL
s
at
u
St
Jo
b
Globus RSL
Job Status
Logging &
Book-keeping
CE i
nfo
Publish
Job Query
Job Submit Event
Author.
&Authen.
SE &
x”
fo
In
bo
er
nd
ok
sa
Br
t“
+
pu
x”
ut
O
bo
nd
sa
t“
pu
In
Resource
Broker
Job Status
Job Submission
Service
Storage
Element
Computing
Element
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 10
GENIUS: A grid portal
Grid Enabled web eNvironment for site Independent User job Submission
• Avoids users needing to learn complex command line
•
•
•
•
interfaces to the Grid
It can be accessed from everywhere and by “everything”
(desktop, laptop, PDA, mobile phone).
It can keep the same user interface to several back-ends.
It must be redundantly “secure” at all levels
Grid services “a mouse click away”.
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 11
The “transparent” grid access
VO
colleague
VO
colleague
local
disk
Replica
Catalogue
Resource
Broker
UI
disk
Compute
Element
Compute
Element
Storage
Element
Storage
Element
Storage
Element
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 12
GILDA
Grid INFN Laboratory for Dissemination Activities
A virtual laboratory to demonstrate/disseminate the strong
capabilities of grid computing.
GILDA incorporates:
• The Gilda Testbed
• GENIUS
• Grid-Demonstrator
• Grid-tutor
• A monitoring system using
GridICE
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 13
Accessing GENIUS 1
Web Sites using Secure http
• GENIUS
https://genius.ct.infn.it
• Grid Demonstrator
https://grid-demo.ct.infn.it
(open access)
• Grid Tutor
https://grid-tutor.ct.infn.it
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 14
Accessing GENIUS 2
PDA
Mobile Phone
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 15
Grid Demonstrator Job Submission
Jobs can be submitted to grid-demo in just 3 steps:
•1
•2
•3
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 16
Jobs and their destinations
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 17
GridICE
A Grid Monitoring System
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 18
Job Output
Virtual reality image of
Mount Etna
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 19
Example Application: ALICE
A Large Ion Collider Experiment
• Collide heavy nuclei to attempt to melt them into
Quark-Gluon Plasma (the state of the universe
before particles had formed).
• Each collision (event) will generate a data file
approximately 2GB large.
• There is expected to be about 109 events per year.
• Expected data produced of order 2 PetaBytes per
year.
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 20
GENIUS and ALICE
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 21
ALICE and Aliroot
ALICE and simulations in Aliroot
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 22
Aliroot 2
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 23
Summary
• With the support of the of the European Union a new
generation of infrastructures for research (GÉANT and
Grids) has been launched – eInfrastructures
• EGEE is building and will operate production-level Grid
• Current EGEE middleware was briefly described
• GILDA testbed was shown via the GENIUS portal
ƒ Grid Demonstrator https://grid-demo.ct.infn.it (open access)
Grids: What are they and where are they going? , NeSC Edinburgh, 6 July 04 - 24