Future releases and feedback
EPCC, University of Edinburgh
Neil Chue Hong
N.ChueHong@epcc.ed.ac.uk
OGSA-DAI Training Workshop - April 2003
Release: P2R2
Phase 1
4Phase 1 – March to September 2002
– GGF DAIS Workgroup Grid Database Spec
– Architectural Framework
– Release 0 - Software Prototypes
• EPCC (XML) - OGSA
• IBM UK (Relational Database) – non OGSA
– Functional Scope for Phase 2
2
OGSA-DAI Training Workshop, Release: P2R2
Phase 2
4Release 1 – Jan 2003
– Basic infrastructure and services. Combine the efforts of
Phase 1 and get the team going in one direction
4Release 2 – Apr 2003
– More functionality and changes to match Grid Service
Specification and Globus Toolkit developments
4Release 3 – June/July 2003
– Final release of Phase 2 to coincide with Globus GT3 release
3
OGSA-DAI Training Workshop, Release: P2R2
Interim Releases
4Interim releases in February and May
4Ensure compatibility with GT3 versions
4Fix known issues registered with development
team
4Documentation updates on more rapid cycle
4
OGSA-DAI Training Workshop, Release: P2R2
What was in Release 1?
4Core OGSA-DAI services only
– No DQP, other high level services
– No graphical client
4GridDataService
4GridDataServiceFactory
4GridDataServiceRegistry
4Example clients
5
OGSA-DAI Training Workshop, Release: P2R2
Features of Release 2 (1)
– GT3 alpha 3 compatible release.
– DB2 support.
– Deploy multiple GDSFs with different configurations within same
container.
– Refactoring of the GDSF Configuration file.
•
•
•
•
Introduction of the data resource concept.
Decoupling of Activity mapping into a separate file.
Decoupling of GDSR into a separate file.
Introduction of data resource implementation mapping file to enhance
connections to data resources.
– Refactoring of GDS-Scripts (now called GDS-Perform documents).
– GDS-Perform document now composed of:
• combined request and execute combination.
• terminate activity to stop running requests.
– Support for new deliver activities:
• deliverToResponse deliverFromURL, …
6
OGSA-DAI Training Workshop, Release: P2R2
Features of Release 2 (2)
–
–
–
–
–
Support the creation/removal of XML collections/documents.
Support of creation/dropping of databases for MySQL and DB2.
Support for stored procedures in DB2.
GDS now implements the GDT portType.
Enhanced performance for the GDS Engine.
• Now handles streams data transparently
• New perform/response
–
–
–
–
–
–
–
–
7
Internal support for Parameter/withParameter activities
Own implementation of WebRowSet.
Removed dependency on the IBM xsdbeans.jar .
Improved performance.
Improved installation procedure.
Improved end-to-end example client.
Added clients to create sample databases.
New example xml document sets
OGSA-DAI Training Workshop, Release: P2R2
What’s to come in future releases?
4 Design Issues
– specify some sort of transactional support for R3
– RDBs must support sufficient metadata to allow queries to be
expressed over the database based on the metadata provided.
– Allow client to specify a data resource from pre-defined schemes,
locations paths in the GDSF-Create document.
– Dereference the acting xml schema corresponding to a data resource
from a GDS so that a client can validate GDS-Perform documents
before submitting to a GDS.
– Extend OGSA-DAI framework so that a GDS can support more than
one data resource - although this may not necessarily be
implemented by OGSA-DAI.
– Clarify the queryLanguage element in the GDSFConfig.
– Clarify behaviour of resources defined in the GDSF Config.
– Clarify implications of allowing separate execute/requests to be
included in a GDS-Perform document.
– Use portType inheritance to refactor OGSA-DAI portTypes.
8
OGSA-DAI Training Workshop, Release: P2R2
Release 2.5 Feature List (1)
4General
– Either GT3-alpha4 or GT3-Beta compatibile.
– Check XPath support in GT3-Alpha 4 and see if can exploit in
our GDSR/GDSF implementations.
– Add instrumentation to the code at key points
– Ensure bundled examples are consistent and have example
responses.
4GDSF configuration process
– Mechanism of DataResourceImplementation file should be
improved
– Need a mechanism for a GDSF to register content with a
GDSR after the start-up process.
9
OGSA-DAI Training Workshop, Release: P2R2
Release 2.5 Feature List (2)
4 GDSF
– Expose valid activity maps together with the associated metadata
through the GDSF's SDEs
– Read files containing specifications of external resources.
– Hide role map information in SDEs and the data provided when
registering with a GDSR.
– Provide additional SDEs if desired.
– Force GDSF to destroy itself if configuration fails.
– Construct registration information via XPath queries over the GDSF.
– Validation of documents against their schema
4 GDS/Engine
– Expose the XML schema that corresponds to the data resource
– Status information for a request published to SDE's.
10
OGSA-DAI Training Workshop, Release: P2R2
Release 2.5 Feature List (3)
4 Activities
– Add metadata/description tags to activityMapping in the activity
mapping schema.
– Allow separate execute/requests to be included in a GDS-Perform
document.
– Modify the CollectionManagementActivity to allow the listing of
collections.
– Modify the ResourceManagementActivity to allow the listing of
resources inside collections.
– Implement activity to create/list indexes. This is not supported by
XML:DB but is supported by Xindice.
– constrain the type of SQL query that can be sent to a GDS
4 Client
– Allow a client to dereference the XML Schema from a GDS' SDEs
corresponding to the data resource the GDS curates to validate GDSPerform documents before they are sent to the GDS.
11
OGSA-DAI Training Workshop, Release: P2R2
What’s coming up in Release 3
4 R3 Enhancements (probable)
– Full GT3 compatability (subject to release of GT3).
– Oracle support
– Support for translation/transformation activities.
• Bundle some example activities, e.g. xslt, compression.
– Documentation for developers wanting to provide their own activity.
– Provide XML support for any XML capabilities in MySQL/DB2/Oracle.
– Provide localization support though not necessarily
internationalization support within OGSA-DAI.
– Some form of transactional support
– Increased logging
4 R3 Enhancements (possible)
– Support for bulk loading into a databse.
– Support for another XML storage system
12
OGSA-DAI Training Workshop, Release: P2R2
Feedback
4 What do you need for your projects?
– Can’t promise to implement everything, but will use feedback to
prioritise additions to the functionality and scope of the software
4 Ask questions on the users mailing list:
– users@ogsadai.org.uk
4 Formal support:
– http://www.ogsadai.org.uk/support/
4 Will also be putting out a user survey to all registered
users
13
OGSA-DAI Training Workshop, Release: P2R2
Course feedback
4Please fill out a course feedback form online,
before you leave!
– http://www.ogsadai.org.uk/courses/feedback.php
14
OGSA-DAI Training Workshop, Release: P2R2