EGEE-II in OMII-Europe
What is EGEE
• EGEE & EGEE-II are providing a production quality grid
infrastructure for Europe and beyond
• Certified middleware installation
• Support mechanisms
• Virtual Organisation management
• Shared resources
• Security
EU project: RIO31844-OMII-EUROPE
EGEE Mission
•
Infrastructure
– Manage and operate production Grid for European Research Area
– Interoperate with e-Infrastructure projects around the globe
– Contribute to Grid standardisation efforts
•
Support applications from diverse communities
– High Energy Physics
– Biomedicine
– Earth Sciences
– Astrophysics
– Computational Chemistry
– Fusion
– Geophysics
– Finance, Multimedia
– …
•
Business
– Forge links with the full spectrum of interested business partners
+ Disseminate knowledge about the Grid through training
+ Prepare for sustainable European Grid Infrastructure
EU project: RIO31844-OMII-EUROPE
Expertise & Resources
• More than 90 partners
• 32 countries
• 12 federations
 Major and national
Grid projects in
Europe, USA, Asia
+ 27 countries
through related projects:
– BalticGrid
– SEE-GRID
– EUMedGrid
– EUChinaGrid
– EELA
EU project: RIO31844-OMII-EUROPE
Virtuous Cycle
• All Activities work in concert to drive the
Virtuous Cycle
• Field-tested and refined during EGEE
EU project: RIO31844-OMII-EUROPE
EGEE – What does it deliver?
•
Infrastructure operation
– Continuous monitoring of grid services in a
distributed global infrastructure
– Automated site configuration/management
•
Middleware
– Production quality middleware distributed under business friendly
open source licence
•
User Support - Managed process from first contact
through to production usage
– Training
– Documentation
– Expertise in grid-enabling applications
– Online helpdesk
– Networking events (User Forum, Conferences etc.)
•
Future
– Expand on interoperability with related infrastructures
EU project: RIO31844-OMII-EUROPE
Use of the infrastructure
Massive data transfers > 1.5 GB/s
• Several applications now depend on EGEE as their
primary computing resource
Sustainability:
• Usage can (and does) grow without need for additional
operational effort
http://goc.grid-support.ac.uk/gridsite/monitoring/
EU project: RIO31844-OMII-EUROPE
Middleware structure
•
•
•
Applications have access both to
Higher-level Grid Services and to
Foundation Grid Middleware
Higher-Level Grid Services are
supposed to help the users building
their computing infrastructure but
should not be mandatory
Foundation Grid Middleware will be
deployed on the EGEE
infrastructure
– Must be complete and robust
– Should allow interoperation with
other major grid infrastructures
– Should not assume the use of
Higher-Level Grid Services
EU project: RIO31844-OMII-EUROPE
gLite Software Process
JRA1 Development
Directives
Error Fixing
Software
Serious
problem
SA3 Integration
SA3 Testing &
Certification
SA1 PreProduction
Deployment
Packages
Problem
Fail
SA1 Production
Infrastructure
Integration
Tests
Testbed
Deployment
Fail
Pass
Functional
Tests
Release
Installation Guide,
Release Notes, etc
Pre-Production
Deployment
Pass
Pass
Fail
Scalability
Tests
EU project: RIO31844-OMII-EUROPE
IntegrationProcess
and Testing
to deployment
Enabling Grids for E-sciencE
Support,analysis,
analysis,debugging
debugging
Support,
Production
Productionservice
service
Pre-production service
Integration
Integration
JRA1
Testing & Certification
SA3
OMIIEurope
…
Middleware providers
VDT/OSG
SA3
Certification activities SA3+SA1
SA1
INFSO-RI-508833
Ian Bird, SA1, EGEE Final Review 23-24th May 2006
14
EU project: RIO31844-OMII-EUROPE
Site Functional Tests
•
Site Functional Tests (SFT)
– Framework to test (sample) services at all
sites
– Shows results matrix
– Detailed test log available for troubleshooting
and debugging
– History of individual tests is kept
– Can include VO-specific tests (e.g. sw
environment)
– Normally >80% of sites pass SFTs
• NB of 180 sites, some are not well
managed
• Very important in stabilising sites:
• Apps use only good sites
• Bad sites are automatically excluded
• Sites work hard to fix problems
Extending to service availability:
• measure availability by service, site, VO
• each service has associated service class
defining required availability (Critical, highly
available, etc.)
First approach to SLA
Use to generate alarms
• generate trouble tickets
• call out support staff
EU project: RIO31844-OMII-EUROPE
Service Overview
Web Application
Web Service
Via browser
Report
DB
Project
DB
Build/Test
Artefacts
NMI Scheduler
Via commandLine tools
Clients
WNs
NMI Client
Wrapper
ETICS Infrastructure
EU project: RIO31844-OMII-EUROPE
QA Certification Process
•
•
•
•
•
It’s the other major goal of the project
ETICS must deliver a feasibility study for the implementation of a QA
certification process for grid and distributed software
Not just a document, but a full assessment of what procedures, tools
and rules maximize the chances of project of delivering reliable,
interoperable software based on the real data collected in two years of
activity
We will propose it as the starting point of a coordinated QA
Certification activity in the context of a more permanent grid
infrastructure initiative
Will be done in close collaboration with the ETICS Experts Board to
make sure it is practical and realistic
EU project: RIO31844-OMII-EUROPE
ETICS for Application Developers
•
•
•
The ETICS Service is targeting the Research community implementing Grid and
distributed software
Advantages
– To reduce the cost of an in-house Integration and build infrastructure, using a
shared multi-platform environment to build and test applications
– To improve the overall quality of software gathering a rich set of indicators
from each build and test session, as well as trends over time
– To extend the control of dependencies including underlying grid middleware.
Requirements
– To model software modules using ETICS guidelines
– Contribute with Computational resources (public or private)
• ETICS builds on Grid resources
EU project: RIO31844-OMII-EUROPE
Summary
• EGEE has created a international production grid
infrastructure.
• This requires robust, reliable, certified middleware
• A middleware dissemination mechanism is also
required.
• OMII-Europe will provide a testing system based on
ETICS
• OMII-Europe will provide a repository of tested,
certified middleware
• Well tested and certified application layer software
for a range of middlewares
EU project: RIO31844-OMII-EUROPE