Grid Portal Services
IeSE (the Integrated e-Science Environment)
Andy Richards & Rob Allan
Contents
• Where are we now?
– IeSE : DataPortal, HPCPortal, InfoPortal
• Why use Portals?
• Where are we going?
– Portal Services : Web Services –> Grid Services
Presenter
Name
e-Science
Centre
Facility Name
Overview
• Grid and e-Science technologies to improve access to and integrate
CLRC's facilities for the UK scientific research community.
• Prototype projects, DataPortal and HPCGrid Portal.
• Main components of these are being re-worked in a service-based
environment which will conform to the Open Grid Services
Architecture (OGSA) being developed by the Globus team and IBM.
• Developments of middleware in the IeSE project will help us to
support other projects, such as DIAMOND, NWGrid and HPCx, using
emerging Grid technologies.
Presenter
Name
e-Science
Centre
Facility Name
DataPortal : General Architecture
User
XML wrapper
Local metadata
CCLRC
DataPortal
Server
XML wrapper
Local metadata
Local data
Local data
Facility 2
Facility 1
Presenter
Name
e-Science
Centre
Facility Name
What is the DataPortal ?
•
Making existing scientific data resources accessible through a single
interface.
•
Acting as a broker between scientists, facilities and data.
Presenter
Name
e-Science
Centre
Facility Name
DataPortal : Shopping Cart
Presenter
Name
e-Science
Centre
Facility Name
Welcome to the HPCPortal
Historically Perl / CGI interface to C/C++ based backend (inc. Globus GT2 Code)
Presenter
Name
e-Science
Centre
Facility Name
HPCPortal Grid Services
Presenter
Name
e-Science
Centre
Facility Name
HPCPortal Search Services
Presenter
Name
e-Science
Centre
Facility Name
HPCPortal Application Search
Presenter
Name
e-Science
Centre
Facility Name
HPCPortal Services
Presenter
Name
e-Science
Centre
Facility Name
InfoPortal
Presenter
Name
e-Science
Centre
Facility Name
InfoPortal
Presenter
Name
e-Science
Centre
Facility Name
InfoPortal (UK Centres Map)
Presenter
Name
e-Science
Centre
Facility Name
UK e-Science Grid Network Monitoring
Presenter
Name
e-Science
Centre
Facility Name
Custom Portals
Presenter
Name
e-Science
Centre
Facility Name
Integrated Portals
GSI
Data Systems
DataPortal
Web Services
GridFTP
Web Services
HPCPortal
Web Services
Visualisation
HPC Systems
Globus
Working with GGF Grid
Computing Environments
Research Group
Presenter
Name
e-Science
Centre
Facility Name
Why Use Portals ?
• Single point of access to remote resources
• Sign on once – Run Anywhere
• Increases security for end user and remote resources
• Reduces potential firewall problems
Presenter
Name
e-Science
Centre
Facility Name
Where are we going ?
• Move towards a modular portal framework
• Separation of presentation layer (e.g. web site / portal) from
backend services
• Implementation of backend services using web-services techniques
and or grid-services as they develop
Presenter
Name
e-Science
Centre
Facility Name
IeSE Project
• The Integrated e-Science Environment comprises DataPortal,
InfoPortal and HPCPortal
• Allows us to evaluate and deploy prototypes which may add value to
the UK e-Science Grid
Presenter
Name
e-Science
Centre
Facility Name
IeSE Functionality
The portals encapsulate functionality which adds value to the simple Grid pillars.
Globus pillar:
Value add:
single sign-on (GSI)
session management and role-based authorisation, expert system and ontologies
resource discovery
(MDS)
monitoring, personal selection and brokering
file transfer (GridFTP
and GASS)
database query and dataset location, replica management and QoS
job submission (GRAM
and GRIP)
query based on application functionality, matching to resources and i/o format and
content, workflow support
Presenter
Name
e-Science
Centre
Facility Name
IeSE Applications
e-Science Pilot Projects, CCPs - strong science base! Projects are now running
and using the re-usable software base of IeSE. Most funded by Research Council
e-Science grants:
• NERC Environment from the molecular level: An e-science proposal for modelling the
atomistic processes involved in environmental issues;
• BBSRC An E-Science Resource for High Throughput Protein Crystallography;
• EPSRC and Core Programme e-Science Technologies in the Simulation of Complex
Materials;
• NERC Data Grid;
• Core Programme UK e-Science Grid deployment project (Level 2 Grid)
• Working with other CLRC departments and collaborators gives powerful science drive.
Presenter
Name
e-Science
Centre
Facility Name
PHPNuke Portal Framework
• PHPNuke is a Content Management System
• Developed in PHP
• Uses MySQL or similar backend database
• Modular Dynamic Architecture
– Configurable using Blocks and Modules
• Inbuilt localisation
• User customisable interface
Presenter
Name
e-Science
Centre
Facility Name
PHPNuke
Presenter
Name
e-Science
Centre
Facility Name
HPCPortal (PHPNuke Version)
Presenter
Name
e-Science
Centre
Facility Name
HPCPortal – User Administration
Presenter
Name
e-Science
Centre
Facility Name
HPCPortal – Modules
Presenter
Name
e-Science
Centre
Facility Name
JetSpeed – Portal Framework
Presenter
Name
e-Science
Centre
Facility Name
JetSpeed – Portal Framework
Presenter
Name
e-Science
Centre
Facility Name
Acknowledgements
• Work on the IeSE project presented in this talk is done by myself
and members of the Grid Technology Group and Data Management
Group at CLRC (both DL and RAL).
• Some work of staff in the UK Grid Support Centre and Grid
Engineering Task Force on the UK e-Science Grid is also mentioned.
Presenter
Name
e-Science
Centre
Facility Name