Enabling Grids for E-sciencE GILDA and GENIUS Guy Warner NeSC Training Team An Induction to EGEE for GOSC and the NGS NeSC, 8th December 2004 www.eu-egee.org INFSO-RI-508833 Overview Enabling Grids for E-sciencE • GILDA • The GILDA Testbed – What is a Grid Testbed? – What is the GILDA Testbed? – Where is the GILDA Testbed? • The GENIUS Portal – – – – What is a Portal? What is the GENIUS Portal? How it works. Advanced Functionalities • The Practical INFSO-RI-508833 GENIUS and GILDA, NeSC, 8th December 04 2 GILDA Enabling Grids for E-sciencE Grid INFN Laboratory for Dissemination Activities A virtual laboratory to demonstrate/disseminate the strong capabilities of grid computing. Run by the EGEE team at INFN Catania (Sicily) under Roberto Barbera GILDA incorporates: • The Gilda Testbed • GENIUS • A monitoring system using GridICE (not covered here) • Its own Virtual Organization and Certificate Authority (not covered here) INFSO-RI-508833 GENIUS and GILDA, NeSC, 8th December 04 3 Enabling Grids for E-sciencE INFSO-RI-508833 The GILDA home page (https://gilda.ct.infn.it) GENIUS and GILDA, NeSC, 8th December 04 4 What is a Testbed Grid? Enabling Grids for E-sciencE • A testbed (according to Google): – A platform on which an assortment of experimental tools and products may be deployed and allowed to interact in real-time. Successful tools and products may be identified and developed in an interactive, evolutionary, interdependent process. – Experimental proof of concept, technology demonstration, pre-prototype. • The GILDA “Testbed Grid”: – Provides a safe environment for new users and communities to gain early experience and training in grids. – New applications can be developed in an environment isolated from already running stable grid applications. INFSO-RI-508833 GENIUS and GILDA, NeSC, 8th December 04 5 The GILDA Testbed Enabling Grids for E-sciencE • An EGEE testbed. • Running the latest stable EGEE middleware • Used for initial porting of new applications into EGEE. • Supports existing and potential new EGEE user communities. • Supports the EGEE training activities. INFSO-RI-508833 GENIUS and GILDA, NeSC, 8th December 04 6 GILDA Sites Enabling Grids for E-sciencE • 12 Sites • 5 Countries INFSO-RI-508833 GENIUS and GILDA, NeSC, 8th December 04 7 Using the Grid without a Portal Enabling Grids for E-sciencE Resource Broker Input “sandbox” “User interface” DataSets info Replica Catalogue Information Service Output “sandbox” Publish Job Query Job Submit Event Author. &Authen. edg-job-list-match HelloWorld.jdl ??? Storage Element edg-job-submit -o job.id HelloWorld.jdl edg-job-status -v 1 -i job.id Logging & Book-keeping Job Status Computing Element edg-job-get-output -i job.id --dir . INFSO-RI-508833 GENIUS and GILDA, NeSC, 8th December 04 8 Using the Grid with a Portal Enabling Grids for E-sciencE INFSO-RI-508833 GENIUS and GILDA, NeSC, 8th December 04 9 Introducing GENIUS Enabling Grids for E-sciencE Several versions of the portal exist: • GENIUS – the full version: https://genius.ct.infn.it • Grid Demonstrator – an ‘open to all’ 24/7 available version: https://grid-demo.ct.infn.it • Grid Tutor – a version designed for training purposes: https://grid-tutor.ct.infn.it INFSO-RI-508833 GENIUS and GILDA, NeSC, 8th December 04 10 GENIUS: A grid portal Enabling Grids for E-sciencE Grid Enabled web eNvironment for site Independent User job Submission • A Portal provides a gateway via a web site to grid/internet functionalities. • GENIUS is a Portal that: – – – – Provides access to the functionality and resources of the grid. Hides the use of the command line. Avoids users needing a deep understanding of grid middleware Accessible from anywhere by desktop, laptop, PDA or mobile phone. – Protects the user from changes to the grid middleware. – Provides the user with a secure environment at all levels – Is simple to use. INFSO-RI-508833 GENIUS and GILDA, NeSC, 8th December 04 11 The GENIUS hourglass model Enabling Grids for E-sciencE INFN/NICEsrl collaboration Applications High level GRID middleware (EGEE Services) Basic Services (VDT) OS & Net services INFSO-RI-508833 GENIUS and GILDA, NeSC, 8th December 04 12 GENIUS: how it works Enabling Grids for E-sciencE Web Server Browser Portal 3-tier model Portal Development Kit User interface INFSO-RI-508833 Grid Services GENIUS and GILDA, NeSC, 8th December 04 13 Portal Security Enabling Grids for E-sciencE • Problem: A web server and hence the portal must run with the lowest possible privileges. How then can it run jobs for the user? • The best answer is to extend the GSI delegation system so that the user can delegate the rights to run the job to the portal. • The MyProxy service provides this extension by: – temporarily storing the users credentials. – starting a proxy service on behalf of the user. – providing a separate passphrase for the portal. INFSO-RI-508833 GENIUS and GILDA, NeSC, 8th December 04 14 Advanced Functionalities Enabling Grids for E-sciencE Interactive Services Application Specific Interfaces Graphic Workflow Editor Peer to Peer Services INFSO-RI-508833 GENIUS and GILDA, NeSC, 8th December 04 15 Summary Enabling Grids for E-sciencE • GILDA is a testbed with a complete suite of grid elements and applications. • GILDA runs and will run the last production (stable) version of the grid middleware (currently Grid.it 2.2.0 based on LCG 2.2.0). • GILDA is the dissemination tool which will be used during induction courses and tutorials • GENIUS is a well established portal which is fundamental in the process of interfacing new applications with the EGEE middleware • GENIUS hides the complex internals of the EGEE middleware from new and non-experts users. INFSO-RI-508833 GENIUS and GILDA, NeSC, 8th December 04 16 The Practical 1 Enabling Grids for E-sciencE • Running Jobs on GILDA by the use of the GENIUS (grid-tutor) portal. – Submission – Monitoring – Retrieving output • Editing the job description file. – Job inputs and outputs – Job Requirements • Basic Data Management – Retrieving data from the grid. INFSO-RI-508833 GENIUS and GILDA, NeSC, 8th December 04 17 Acknowledgements Enabling Grids for E-sciencE • Some of the slides used in this talk are based on slides originally given by Roberto Barbera of INFN, Catania INFSO-RI-508833 GENIUS and GILDA, NeSC, 8th December 04 18