Enabling Grids for E-sciencE
GILDA and GENIUS
Guy Warner
NeSC Training Team
An induction to EGEE for GOSC and the NGS
NeSC, 8th December 2004
www.eu-egee.org
INFSO-RI-508833
Overview
Enabling Grids for E-sciencE
• GILDA
• The GILDA Testbed
– What is a Grid Testbed?
– What is the GILDA Testbed?
– Where is the GILDA Testbed?
• The GENIUS Portal
–
–
–
–
What is a Portal?
What is the GENIUS Portal?
How it works.
Advanced Functionalities
• The Practical
INFSO-RI-508833
GENIUS and GILDA, NeSC, 8th December 04
2
GILDA
Enabling Grids for E-sciencE
Grid INFN Laboratory for Dissemination Activities
A virtual laboratory to demonstrate/disseminate the
strong capabilities of grid computing.
Run by the EGEE team at INFN Catania (Sicily) under
Roberto Barbera
GILDA incorporates:
• The Gilda Testbed
• GENIUS
• A monitoring system using GridICE (not covered here)
• Its own Virtual Organization and Certificate Authority
(not covered here)
INFSO-RI-508833
GENIUS and GILDA, NeSC, 8th December 04
3
Enabling Grids for E-sciencE
INFSO-RI-508833
The GILDA home page
(https://gilda.ct.infn.it)
GENIUS and GILDA, NeSC, 8th December 04
4
What is a Testbed Grid?
Enabling Grids for E-sciencE
• A testbed (according to Google):
– A platform on which an assortment of experimental tools and products may
be deployed and allowed to interact in real-time. Successful tools and
products may be identified and developed in an interactive, evolutionary,
interdependent process.
– Experimental proof of concept, technology demonstration, pre-prototype.
• The GILDA “Testbed Grid”:
– Provides a safe environment for new users and communities to
gain early experience and training in grids.
– New applications can be developed in an environment isolated
from already running stable grid applications.
INFSO-RI-508833
GENIUS and GILDA, NeSC, 8th December 04
5
The GILDA Testbed
Enabling Grids for E-sciencE
• An EGEE testbed.
• Running the latest stable EGEE middleware
• Used for initial porting of new applications into EGEE.
• Supports existing and potential new EGEE user
communities.
• Supports the EGEE training activities.
INFSO-RI-508833
GENIUS and GILDA, NeSC, 8th December 04
6
GILDA Sites
Enabling Grids for E-sciencE
• 12 Sites
• 5 Countries
INFSO-RI-508833
GENIUS and GILDA, NeSC, 8th December 04
7
Using the Grid without a Portal
Enabling Grids for E-sciencE
“User
interface”
Input “sandbox”
Output “sandbox”
DataSets info
Replica
Catalogue
Information
Service
Resource
Broker
Publish
Job Query
Job Submit Event
Author.
&Authen.
edg-job-list-match HelloWorld.jdl
???
edg-job-submit -o job.id HelloWorld.jdl
Storage
Element
edg-job-status -v 1 -i job.id
edg-job-get-output -i job.id --dir .
Logging &
Book-keeping
INFSO-RI-508833
Job Status
Computing
Element
GENIUS and GILDA, NeSC, 8th December 04
8
Using the Grid with a Portal
Enabling Grids for E-sciencE
“User
interface”
Input “sandbox”
Output “sandbox”
DataSets info
Replica
Catalogue
Information
Service
Resource
Broker
INFSO-RI-508833
Publish
Logging &
Book-keeping
Job Query
Job Submit Event
Author.
&Authen.
Storage
Element
Job Status
Computing
Element
GENIUS and GILDA, NeSC, 8th December 04
9
Introducing GENIUS
Enabling Grids for E-sciencE
Several versions of the portal
exist:
• GENIUS – the full version:
https://genius.ct.infn.it
• Grid Demonstrator – an
‘open to all’ 24/7 available
version:
https://grid-demo.ct.infn.it
• Grid Tutor – a version
designed for training
purposes:
https://grid-tutor.ct.infn.it
INFSO-RI-508833
GENIUS and GILDA, NeSC, 8th December 04
10
GENIUS: A grid portal
Enabling Grids for E-sciencE
Grid Enabled web eNvironment for site Independent
User job Submission
• A Portal provides a gateway via a web site to
grid/internet functionalities.
• GENIUS is a Portal that:
–
–
–
–
Provides access to the functionality and resources of the grid.
Hides the use of the command line.
Avoids users needing a deep understanding of grid middleware
Accessible from anywhere by desktop, laptop, PDA or mobile
phone.
– Protects the user from changes to the grid middleware.
– Provides the user with a secure environment at all levels
– Is simple to use.
INFSO-RI-508833
GENIUS and GILDA, NeSC, 8th December 04
11
The GENIUS hourglass model
Enabling Grids for E-sciencE
INFN/NICEsrl collaboration
Applications
High level GRID middleware
(EGEE Services)
Basic Services
(VDT)
OS & Net services
INFSO-RI-508833
GENIUS and GILDA, NeSC, 8th December 04
12
GENIUS: how it works
Enabling Grids for E-sciencE
Web Server
Browser
Portal
3-tier model
Portal
Development Kit
User
interface
INFSO-RI-508833
Grid Services
GENIUS and GILDA, NeSC, 8th December 04
13
Portal Security
Enabling Grids for E-sciencE
• Problem: A web server and hence the portal must run
with the lowest possible privileges. How then can it run
jobs for the user?
• The best answer is to extend the GSI delegation system
so that the user can delegate the rights to run the job
to the portal.
• The MyProxy service provides this extension by:
– temporarily storing the users credentials.
– starting a proxy service on behalf of the user.
– providing a separate passphrase for the portal.
INFSO-RI-508833
GENIUS and GILDA, NeSC, 8th December 04
14
Advanced Functionalities
Enabling Grids for E-sciencE
Interactive Services
Application Specific Interfaces
Graphic Workflow Editor
Peer to Peer Services
INFSO-RI-508833
GENIUS and GILDA, NeSC, 8th December 04
15
Summary
Enabling Grids for E-sciencE
• GILDA is a testbed with a complete suite of grid
elements and applications.
• GILDA runs and will run the last production (stable)
version of the grid middleware (currently Grid.it 2.2.0
based on LCG 2.2.0).
• GILDA is the dissemination tool which will be used
during induction courses and tutorials
• GENIUS is a well established portal which is
fundamental in the process of interfacing new
applications with the EGEE middleware
• GENIUS hides the complex internals of the EGEE
middleware from new and non-experts users.
INFSO-RI-508833
GENIUS and GILDA, NeSC, 8th December 04
16
The Practical 1
Enabling Grids for E-sciencE
• Running Jobs on GILDA by the use of the GENIUS
(grid-tutor) portal.
– Submission
– Monitoring
– Retrieving output
• Editing the job description file.
– Job inputs and outputs
– Job Requirements
• Basic Data Management
– Retrieving data from the grid.
INFSO-RI-508833
GENIUS and GILDA, NeSC, 8th December 04
17
The Practical 2
Enabling Grids for E-sciencE
• Log in to your workstation
– UserName: student
– Password: G05Cu53r
(that’s a zero)
• Open a web browser and go to
http://homepages.nesc.ac.uk/~gcw/GENIUS/
• Your GENIUS identification is:
– UserName: edinburghXX where XX is the number of the lab PC
you are sat in front of (e.g. edinburgh05)
– Password: GridEDIXX where XX is as above
– MyProxy passphrase: EDINBURGH
• Follow the instructions from there on in.
INFSO-RI-508833
GENIUS and GILDA, NeSC, 8th December 04
18