Middleware for
Campus Grids
Steven Newhouse, ETF Chair
(& Deputy Director, OMII)
Which Grid Middleware?







gLite (EGEE)
OMII
GT4
UnitedDevices
GridSystems
CROWN
….
©
What are your requirements?



Research vs. supporting research
Bleeding edge vs. production
Your potential user community:



‘Intelligence’
Pain threshold
Upfront cost vs. medium/long term costs
©
ETF: Historical Role


Started September 2001
Technical forum to build the UK Grid:




GSC
DTI/EPSRC Regional Centres
Working Groups in 10+ areas
Achievements:



Established UK expertise
Level 1 Grid: Basic compute/file grid
Level 2 Grid: L1 + Application users
©
ETF: Current Activities

Integrated with GOSC

0.5 FTE from each regional centre



Total 4 FTEs over ~12 people
Leverage wider expertise within the community
Evaluating software for production deployment



Continue plenary meetings
Focussed short–term ‘action lines’
Evaluation Criteria
©
‘Standard’ Evaluation Criteria



Collect the same information
Try and answer the same questions
Focus on:






General Background Information
Systems Management
User’s Experience
Developer’s Experience
Technical
Relate to NGS environment
©
ETF: In context
Software with proven
Other Software Services
EGEE
OMII
capability & realistic
deployment experience
Services
Distribution
NGS
ETF
Prototypes &
Feedback &
Specifications
future requirements
©
ETF: Broader context
User
requirements
Software
providers
ETF
NGS
Software
providers
Operations
Software
providers
Provider
requirements
GOSC
Board
©
UK
Campus
and
other
Grids
Secured Condor Pool



Authorised Condor Flocking
Use GSI to control access to daemons
Flocking through firewalls
©
UDDI


Explore use of UDDI v2
Replication of registry




No support at UDDI level
Very hard to do at the database level
Poor support for provenance & meta-data
Grimoires from OMII to address some issues
©
GridSystems




Commercial product
InnerGrid: Within the firewall
OuterGrid: Between systems (not evaluated)
Use of Tomcat/Axis as server



Agents represent resources
Modules represent applications
Tasks represent modules running on agents
©
GT4

Major new release of the Globus Toolkit






Implementation of WSRF
Improved GridFTP
Improved WS-GRAM w.r.t. GT3.x
Straightforward portable source & binary installers
High quality structured documentation for installation
& development
Pure Java code OK on both Linux and Windows
©
GT4 Components
©
GT4 Migration

From GT3:



A few straight forward changes to service
interfaces.
Improved service performance & reliability
From GT2.4:

Pre WS components interoperate
©
GT4 Issues

No migration guide for GT2 developers


Developing Grid systems


BUT compatibility library for API
As opposed to just GridServices
Integration of new DRM into system

Sun Grid Engine
©
OMII 1:Basic Services

Services to meet the needs of stakeholders



Functional: Data & Application execution



Service Provider: I have something to share
Users: I want to use these shared resources
Running jobs using pre-installed applications
Movement of input and output data files
Management: Account and Resources


Must have an account with a service provider
Or delegated access to someone else’s account
©
OMII 1: Architecture
Management
(Browser)
Admin
Application
database
of
accounts
resources
applications
WS Security
Web Services
resources
Accounting
Client
Application
Resource Mgmt
Data Staging
computation
data storage
applications
Application
Application
Job Submission
©
Tomcat & Axis
Application
OMII 1: Stack
USER
Application
ExampleService
PBAC
TestService
Job
Data
Allocation
Account
Resource Acct
Mgmt
Mgmt
Servlet Servlet
Happy
Axis
WS-Security
AXIS
TOMCAT
©
Static Webpage
OMII 1: Summary




Robust and straightforward deployment on
supported platforms
Applications need to be installed on the
machine
Does what it says on the tin
What it does it does well
©
gLite





Early releases have been deployed OK
Suggested deployment requires ~6 machines
Package install OK (but gHeavy!)
Configuration complex
Evaluation on hold
©
Summary

Complete



Reports will go on the ETF website
when complete.
Feed into NGS deployment decisions
Finishing




UDDI Registry
Condor
GridSystems
GT4
OMII 1
Underway




GridMP
Distributed visualisation (RAVE)
gLite (hibernating)
CROWN
©