New Productivity Initiative WG Architectural Area Grid Forum for Dummies P. Foley Platform Computing May 2002 “Global Grid Forum for Dummies” 1 Abstract The Global Grid Forum is becoming a large and dynamic group. It becomes hard to determine the right groups or people to communicate ideas or to obtain information. This document is a summary of the Global Grid Forum Areas, Working Groups and Research Groups, and describes the different groups, their charters, and objectives as of March 2002. This is a living document and with new groups and directions of groups this document is updated. The NPi working group worked on this document to find the connections that it has with the other groups in the Global Grid Forum. pfoley@platform.com 1 New Productivity Initiative WG Architectural Area Grid Forum for Dummies P. Foley Platform Computing May 2002 Table of Contents 1 ABSTRACT ............................................................................................................................ 1 2 GGF-NPI INTERSECTIONS ............................................................................................. 4 3 QUESTIONS ......................................................................................................................... 5 4 GRID INFORMATION SERVICES AND PERFORMANCE AREA............................ 5 4.1 Background on Performance portion: 6 4.2 WG GOS Grid Object Specification 9 4.3 WG GNF Grid Notification Framework 10 4.4 WG MDS Metacomputing Directory Services 11 4.5 WG GMA Grid Monitoring Architecture 11 4.6 WG NM Network Monitoring 12 4.7 WG Grid Event Service - Proposed 13 4.8 RG RDIS Relational Database Information Services 13 4.9 WG Sensor Management – Proposed 15 4.10 WG DAMED Discovery and Monitoring Event Description 15 4.11 RG Grid Benchmarking – Proposed 17 5 SECURITY AREA ............................................................................................................... 19 5.1 WG GSI Grid Security Infrastructure 19 5.2 WG GCP Grid Certificate Policy 21 6 SCHEDULING AND RESOURCE MANAGEMENT AREA ......................................... 22 6.2 WG Advanced Reservation 24 6.3 WG GRM Grid Resource Management 24 6.4 WG SG Scheduler Attributes 25 6.5 WG SD Scheduling Dictionary 27 6.6 WG DRMAA Distributed Resource Management Application API 28 6.7 RG OPT Scheduler Optimization - Proposed 29 6.8 WG SCLA Scheduler Command Line API - Proposed 30 7 ARCHITECTURE AREA .................................................................................................... 31 7.2 WG JINI 32 7.3 WG NPIA NPi Architecture 35 7.4 WG OGSI Open Grid Services Infrastructure 36 7.5 RG GPA Grid Protocol Architecture 37 7.6 RG ACCT Accounting Models 38 7.7 WG Accounting Record Format – Proposed 40 7.8 WG Open Source Software Licensing – Proposed 40 7.9 RG Grid Economies – Proposed 40 7.10 SGNP WG Proposed 1 March 2002 41 8 DATA AREA ........................................................................................................................ 42 8.2 WG GridFTP GridFTP 43 8.3 WG GDWG Grid Databases 43 8.4 RG Persistent Archives 44 8.5 RG Data Replication 45 8.6 WG Archiving Command Line API – Proposed 45 8.7 RG DataGrid Schema – Proposed 45 8.8 RG Application Metadata – Proposed 45 8.9 RG Network Storage – Proposed 45 pfoley@platform.com 2 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 9 APPLICATIONS, PROGRAMMING MODELS & ENVIRONMENTS AREA......... 45 9.2 WG Distributed Applications Metadata 48 9.3 RG APPS Applications & Testbeds 48 9.4 RG GUS Grid User Services 49 9.5 RG GCE Grid Computing Environments 50 9.6 RG APM Advanced Programming Models 54 9.7 RG ACE Advanced Collaborative Environments 54 10 10.1 10.2 10.3 AREA TO BE DETERMINED ....................................................................................... 56 RG GHPNRG Grid High-Performance Networking Research Group 56 WG Cluster Standardizations – Proposed 58 Discovery and Monitoring Event Description WG 58 pfoley@platform.com 3 New Productivity Initiative WG Architectural Area Grid Forum for Dummies 2 P. Foley Platform Computing May 2002 GGF-NPi Intersections GGF NPi Area - Grid Information Services WG - Grid Object Specification (GOS) WG - Grid Notification Framework (GNF) + notification matrix WG - Metacomputing Directory Services (MDS) + meta-computing layer RG - Relational Database Information Services (RDIS) ? Area - Security WG - Grid Security Infrastructure (GSI) + security actor WG- Grid Certificate Policy (GCP) + security actor Area - Scheduling and Resource Management WG - Advanced Reservation ++ work request WG - Scheduling Dictionary ++ resource definition language WG - Scheduler Attributes ++ resource definition language Area – Performance WG - Grid Monitoring Architecture + monitoring, job profile WG - Network Monitoring Area – Architecture WG - JINI ? WG - NPIA WG - OGSI +++ MC layer, policies RG - Grid Protocol Architecture (GPA) ? RG - Accounting Models (ACCT) ++ accounting actor Area – Data WG - GridFTP RG - Data Replication RG - Persistent Archives pfoley@platform.com ? 4 New Productivity Initiative WG Architectural Area Grid Forum for Dummies P. Foley Platform Computing May 2002 Area- Applications, Programming Models & Environments RG - Applications & Test beds (APPS) + exec env layer RG - Grid User Services (GUS) ? RG - Grid Computing Environments (GCE) ++ exec env layer RG - Advanced Programming Models (APM) ? RG - Advanced Collaborative Environments (ACE) ? 3 Questions What is the current status and name of the following WG? DAMED Discovery and Monitoring Event Description a.k.a. DMSI Discovery and Monitoring Schema for Interoperability? What is the current status of the SGNP WG? What is the current status and who is driving the Sensor Management WG (found in Catlett’s list of proposed groups, March 2002)? What is the current status and who is driving the Grid Event Service WG (found in Catlett’s list of proposed groups, March 2002)? How will the GGF identify and manage parallel efforts? As new groups are quickly created the sheer number of topic intersections expands rapidly. This is more than an issue of embarrassment, can lead to competing standards. For example reading the NMWG mail archive and the DAMED strawman document it is clear that there is some overlap. What is the current status of the proposed Scheduling Optimization RG? The Accounting Models research group includes reference to the Distributed Accounting Working Group. Are there two groups or just one? What is the current status of the proposed Accounting Record Format WG (found in Catlett’s list of proposed groups, March 2002)? The following groups are listed in Catlett’s Proposed GGF Group document (March 2002), no other references found through the GGF web site. What is the status of these groups? 4 • Archiving Command Line API • DataGrid Schema • Application Metadata Grid Information Services and Performance Area • Working Groups • 1 Proposed Working Group • 1 Working Group of unknown status (DAMED) • 1 Research Group pfoley@platform.com 5 New Productivity Initiative WG Architectural Area Grid Forum for Dummies 4.1 Background on Performance portion: P. Foley Platform Computing May 2002 This working group focuses on various issues related to the measurement and analysis of the end-to-end performance of parallel and distributed applications. The issues include (1) characterizing the quality of information delivered by monitoring tools; (2) developing a repository of various monitoring and analysis tools; (3) identifying system requirements for monitoring; (4) aid in defining a schema for data formats for monitoring; (5) make recommendations on the pervasiveness of instrumentation. PERF was previously a GGF "working group" but is in the process of becoming an area with initially a single working group. For more information please visit the PERF website. 4.1.1 People Director Ian Baird ibaird@platform.com Director Domenico Laforenza domenico.laforenza@cnuce.cnr.it 4.1.2 Contact Data The original Grid Information Service working group has transitioned to an area. The following mailing list and web site information now apply to the Grid Information Services area: The working group has established a mailing list "gis-wg@gridforum.org". To subscribe to this list send an e-mail to majordomo@gridforum.org with subscribe gis-wg in the message body. To unsubscribe simply replace the subscribe command with an unsubscribe. The list of members can be obtained by sending the command "who gis-wg". More commands can be found from the manual pages for majordomo. This mailing list is archived by date at http://www-unix.gridforum.org/mail_archive/gis-wg/maillist.html and by thread under http://www-unix.gridforum.org/mail_archive/gis-wg/threads.html WebSite: http://www-unix.mcs.anl.gov/gridforum/gis The Web page is currently maintained by Gregor von Laszewski, (gregor@mcs.anl.gov). We are looking for volunteers who can take over this activity. Older web pages are still available at http://www-unix.mcs.anl.gov/gridforum/gis/old/index.html 4.1.3 Documents/Papers GWD-GIS-000-1 The Gridforum Information Services Working Group Charter (HTML: http://www-unix.mcs.anl.gov/gridforum/gis/) (this document) Status: in constant progress GWD-GIS-001 GOSv1: Defining Schemas for the Grid Information Service (PS: http://www-unix.mcs.anl.gov/gridforum/gis/reports/gos-v1/gos-v1.ps) (PDF: http://www-unix.mcs.anl.gov/gridforum/gis/reports/gos-v1/gos-v1.pdf) pfoley@platform.com 6 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 (HTML: http://www-unix.mcs.anl.gov/gridforum/gis/reports/gos-v1/html/index.html, incomplete HTML please use PS or PDF) Status: obsoleted by GWD-GIS-011 GWD-GIS-002 MDSMLv1: A XML binding for the Grid Object Specification (PS: http://www-unix.mcs.anl.gov/gridforum/gis/reports/mdsml-v1/mdsml-v1.ps) (PDF: http://www-unix.mcs.anl.gov/gridforum/gis/reports/mdsml-v1/mdsml-v1.pdf) (HTML: http://www-unix.mcs.anl.gov/gridforum/gis/reports/mdsml-v1/html/index.html, incomplete HTML please use PS or PDF) Status: in progress for GGF3 GWD-GIS-003 RISML: Resource Information Service Markup Language (HTML: http://www-unix.mcs.anl.gov/gridforum/gis/reports/risml/riscore.html) Status: draft, this document does not pass the editorial process for a GWD. Authors, references, and description are missing. GWD-GIS-004 Representing People in the Grid (PS: http://www-unix.mcs.anl.gov/gridforum/gis/reports/people/people.ps) (PDF: http://www-unix.mcs.anl.gov/gridforum/gis/reports/people/people.pdf) Status: stalled Other related publication (PDF: http://wwwunix.mcs.anl.gov/gridforum/gis/reports/people/eduPersonV1.pdf) GWD-GIS-005 Representing Compute Resources in the Grid Status: stalled till GOSv2 is finished. GWD-GIS-006 GXD: Grid eXtensible Data, a dialect of XML for uniform access to data and metadata (http://www.nas.nasa.gov/~pv/gxd/) Status: completed, no push for standard document yet. GWD-GIS-008 Software Objects for the Grid (PDF: http://www-unix.mcs.anl.gov/gridforum/gis/reports/software/software.pdf) (PS: http://www-unix.mcs.anl.gov/gridforum/gis/reports/software/software.ps) (HTML: http://www-unix.mcs.anl.gov/gridforum/gis/reports/software/html/) Status: draft GWD-GIS-010-1 The Draft Meeting Notes Digest of the Grid Information Services Working Group (PDF: http://www-unix.mcs.anl.gov/gridforum/gis/meetings/meetings.pdf) pfoley@platform.com 7 New Productivity Initiative WG Architectural Area Grid Forum for Dummies (PS: http://www-unix.mcs.anl.gov/gridforum/gis/meetings/meetings.ps) P. Foley Platform Computing May 2002 (HTML: http://www-unix.mcs.anl.gov/gridforum/gis/meetings/html/) Status: final, working group internal GWD-GIS-011 GOSv2: Defining Schemas for the Grid Information Service (PS: http://www-unix.mcs.anl.gov/gridforum/gis/reports/gos-v1/gos-v1.ps) (PDF: http://www-unix.mcs.anl.gov/gridforum/gis/reports/gos-v2/gos-v2.pdf) Status: obsoleted by GWD-GIS-21 GWD-GIS-012-1 A Unified Relational Approach to Grid Information Services (PDF: http://www-unix.mcs.anl.gov/gridforum/gis/reports/relational/relational.pdf) (PS: http://www-unix.mcs.anl.gov/gridforum/gis/reports/relational/relational.ps) Status: draft GWD-GIS-015-04 Using Object Identifiers in the Grid Forum Standards Process (PDF: http://www-unix.mcs.anl.gov/gridforum/gis/reports/oid/gwd-gis-draft-oid.pdf) (PS: http://www-unix.mcs.anl.gov/gridforum/gis/reports/oid/gwd-gis-draft-oid.ps) Status: draft GWD-GIS-016-01 LDAP IETF Report (PDF: http://www-unix.mcs.anl.gov/gridforum/gis/reports/ldapietf/gwd-gis-016-01.pdf) (MSWord: http://www-unix.mcs.anl.gov/gridforum/gis/reports/ldapietf/gwd-gis-016-01.doc) (HTML: http://www-unix.mcs.anl.gov/gridforum/gis/reports/ldapietf/gwd-gis-016-01.htm) Status: draft GWD-GIS-018-00 Working Title: The MDS-2 Paper (PDF: http://www-unix.mcs.anl.gov/gridforum/gis/reports/mds2/gwd-gis-018-00.pdf) (MSWord: http://www-unix.mcs.anl.gov/gridforum/gis/reports/mds2/gwd-gis-018-00.doc) (HTML: http://www-unix.mcs.anl.gov/gridforum/gis/reports/mds2/gwd-gis-018-00.htm) Status: draft GWD-GIS-019-01 Working Title: The Grid Notification Framework (PDF: http://www-unix.mcs.anl.gov/gridforum/gis/reports/notification/GISGridNotificationFramework.pdf) Status: draft GWD-GIS-020-01 Working Title: RDF pfoley@platform.com 8 New Productivity Initiative WG Architectural Area Grid Forum for Dummies (PDF: http://www-unix.mcs.anl.gov/gridforum/gis/reports/rdf/GIS-RDF.pdf) P. Foley Platform Computing May 2002 (PS: http://www-unix.mcs.anl.gov/gridforum/gis/reports/rdf/GIS-RDF.ps) Status: draft GWD-GIS-021-001 GOSv3: Defining Schemas for the Grid Information Service (HTML: http://www-unix.mcs.anl.gov/gridforum/gis/reports/gos-v3/gis-wg-021-002.html) Status: draft 4.2 4.2.1 WG GOS Grid Object Specification People Co-chair Gregor von Laszewski gregor@mcs.anl.gov Co-chair Steve Fitzgerald steve@isi.edu Co-chair Michael Helm helm@fionn.es.net Secretary Brett Didier brett.didier@pnl.gov 4.2.2 Contact Data See area contact data above. 4.2.3 Charter This area group tries to identify requirements for and facilitate the development of interoperable models and mechanisms for the information services necessary for doing grid-based computing. This includes The definition of meta-models to allow the creation of interchangeable schemas. The definition of formalisms to describe such schemas uniformly by the various working groups. The definition of a mechanism to access information that is stored in the schema. The educational outreach in order to provide the working groups with the necessary knowledge to use the models, the formalisms, and the mechanisms. The verification of the feasibility of the models, formalism, and mechanisms together with deployment teams (This working group does not have its own deployment team). 4.2.4 Goals and Milestones GGF Toronto Determine the area working group chair(s) Update the charter Obtain date when the summary eduPerson will be available. (Brett Diedier). What is the status of the working groups Implications of Web services. Update the meeting notes pfoley@platform.com 9 New Productivity Initiative WG Architectural Area Grid Forum for Dummies update the numbers for the documents and correct section 7.2 P. Foley Platform Computing May 2002 GGF after Toronto Prepare the submission of the GOS document to the next stage Close the GOS working group Software object Computer object Network object 4.2.5 Documents/Papers GWD-GIS-0001 The Gridforum Information Services Working Group Charter (HTML) GWD-GIS-001 GOSv1: Defining Schemas for the Grid Information Services (PDF) GWD-GIS-002 MDSMLv1: A XML binding for the Grid Object Specification (PDF) GWD-GIS-003 Resource Information Service Markup Language (HTML) GWD-GIS-004 Representing People in the Grid (PDF) GWD-GIS-005 Representing Compute Resources in the Grid (stalled till GOSv2 is finished) GWD-GIS-006 GXD eXtensible Data, a dialect of XML for uniform access to data and metadata (DOC) GWD-GIS-008 Software Objects for the GRID (PDF) GWD-GIS-010-1 Draft Meeting Notes of GIS working Group (PDF) GWD-GIS-011 Defining Schemas for the Information Services - obsolete by GWD-GIS-21 (PDF) GWD-GIS-012-1 Unified Relational Approach to Grid Information Services (PDF) GWD-GIS-015-04 Using Identifiers in the Grid Forum Standards Process (PDF) GWD-GIS-016-01 LDAP IETF Report (PDF) GWD-GIS-018-00 The MDS-2 Paper Software Objects for the GRID (PDF) GWD-GIS-019-01 Grid Notification Framework (PDF) GWD-GIS-020-01 RDF (PDF) GWD-GIS-021-001 Defining Schemas for the Grid Information Services (HTML) 4.2.6 4.3 History WG GNF Grid Notification Framework Appears to be an ‘empty-room’ working group that unsuccessfully spun off from the original GIS working group. 4.3.1 People Co-chair Gregor von Laszewski pfoley@platform.com gregor@mcs.anl.gov 10 New Productivity Initiative WG Architectural Area Grid Forum for Dummies Co-chair Steve Fitzgerald steve@isi.edu Co-chair helm@fionn.es.net Michael Helm 4.3.2 Contact Data 4.3.3 Charter 4.3.4 Goals and Milestones 4.3.5 Documents/Papers 4.3.6 History 4.4 P. Foley Platform Computing May 2002 WG MDS Metacomputing Directory Services Another ‘empty-room’ working group. 4.4.1 People Co-chair Gregor von Laszewski gregor@mcs.anl.gov Co-chair Steve Fitzgerald steve@isi.edu Co-chair Michael Helm helm@fionn.es.net 4.4.2 Contact Data 4.4.3 Charter 4.4.4 Goals and Milestones 4.4.5 Documents/Papers 4.4.6 History 4.5 4.5.1 WG GMA Grid Monitoring Architecture People Dan Gunter pfoley@platform.com 11 New Productivity Initiative WG Architectural Area Grid Forum for Dummies 4.5.2 Contact Data Web Site: Home Page : http://www-didc.lbl.gov/GridPerf/ P. Foley Platform Computing May 2002 Email Archive: http://www-unix.gridforum.org/mail_archive/perf-wg/maillist.html Grid Monitoring Architecture Working Group (GMA-WG) - This was the previous "main" performance working group. The charters and goals, etc. are out of date, but archived information such as talks, meeting minutes, etc. are all there. 4.5.3 Charter The Grid Monitoring Architecture working group is focused on producing a high-level architecture statement of the components and interfaces needed to promote interoperability between heterogeneous monitoring systems on the Grid. The main products of this work are the architecture document itself, and accompanying case studies that illustrate the concrete application of the architecture to monitoring problems. The documents, testbed, tools archives, etc., on this group's page were the result of discussions and efforts over a 3-year period, mostly involving the GMA but also ranging to topics such as timestamps and relational models for monitoring data. 4.5.4 Goals and Milestones before GGF5 -- Shepherd the GMA (16-2) and Simple Case Study (9-2) documents through the GGF document process. 4.5.5 Documents/Papers 4.5.6 History 4.6 4.6.1 WG NM Network Monitoring People Co-chair Bruce Lowekamp lowekamp@cs.wm.edu Co-chair Brian Tierney bltierney@lbl.gov 4.6.2 Contact Data Mailing List: <perf-wg@gridforum.org> is used for WG communication. Please prefix all subjects with NMWG: Subscription Request: send an email to <majordomo@gridforum.org> with the body "subscribe perf-wg" Web Site: Home Page : http://www-didc.lbl.gov/NMWG/ Email Archive: http://www-unix.gridforum.org/mail_archive/perf-wg/maillist.html 4.6.3 Charter The performance of most grid applications is dependent on the performance of the networks forming the grid. The Network Measurements Working Group (NMWG) identifies and pfoley@platform.com 12 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 characterizes metrics useful to grid applications and middleware, and develops standards to ensure the compatibility of metrics across measurement systems and applications. The NMWG focuses on metrics of interest to grid applications and works in collaboration with, other standards groups such as the IETF IPPM WG and the Internet2 End-to-end initiative. The NMWG will determine which of the metrics defined by such groups are relevant to Grid applications, and pursue standardization of metrics of shared interest to multiple communities. The first product of the NMWG will be to a catalog of existing metrics in use by grid performance tools, including accuracy guidelines for each metric. This document will establish a dictionary that can be used by tools to share metrics. The second product will be a document recommending conversions to be used between different metrics of the same underlying behavior or quantity. A published document on such conversions will greatly increase the portability of these metrics between systems and applications. 4.6.4 Goals and Milestones Oct 2001 Establish charter and goals, begin work on structure of metrics document Feb 2002 Entries for most of metrics document, Discussion on best practices recommendations Feb 2002 Begin discussions on conversions document July 2002 Release metrics document to GGF standards track July 2002 Draft of conversions document Fall 2002 Release conversions document to standards track 4.6.5 Documents/Papers Current Working Documents Current DRAFT OUTLINE of Network Metrics Document Meeting Summaries, Minutes, and Slides GGF4 Metrics Meeting and Measurements Presentations GGF3 BOF meeting 4.6.6 4.7 History WG Grid Event Service - Proposed No reference found on the GGF Web Site. 4.8 RG RDIS Relational Database Information Services GGF Web site page for this Research Group has not been updated as of 6 May 2002. 4.8.1 People Peter A. Dinda pdinda@cs.northwestern.edu Beth A. Plale plale@cs.indiana.edu pfoley@platform.com 13 New Productivity Initiative WG Architectural Area Grid Forum for Dummies Steve Fisher P. Foley Platform Computing May 2002 S.M.Fisher@rl.ac.uk Brian Coghlan Trinity College, University of Dublin Matt Zielinski Northwestern An-cheng Huang Carnegie Mellon Rajkumar Buyya Monash University Troung Hong Linh University of Vienna 4.8.2 Contact Data Web Site: http://www.cs.northwestern.edu/relational-gis Mailing List: relational-gis@cs.northwestern.edu 4.8.3 Charter This is the web site of the Relational Grid Information Services (RGIS) Research Group, which is within the Grid Information Area of the Global Grid Forum. The RGIS research group serves researchers who are exploring approaches to static and dynamic Grid information that are based on the relational data model. It has its roots in a task group under the Grid Information Services (GIS) working group and in work on relational approaches to performance data within the Grid Performance Working Group. Description The RGIS research group serves researchers who are leveraging the strengths of the relational data model for defining, communicating, recording, and querying static and dynamic Grid information. It has its roots in a task group under the Grid Information Services (GIS) Working Group and in work on relational approaches to performance data within the Grid Performance Working Group. The relational services the group explores are intended to be complementary to the non-relational services being developed within these other groups. If the research conducted by this group is successful, a new working group will be formed to create standards for interoperability. 4.8.4 Goals and Milestones The group expects that the following goals will be pursued and met: Coordinate among different research efforts, producing informational drafts. The goal of this coordination is to further the research efforts of the individual groups through cross-pollination. (due: ongoing) (people: Dinda, Plale, Fisher) Create an archive of GIS and performance data, and traces of queries to this data, and write an informational draft describing the traces and their properties (due: 2002) (people: Dinda, Plale, Fisher) Develop appropriate extensible schemas and indices for Grid information, including an extensible type hierarchy for data objects, and the definition of a set of core types. This will be done in cooperation with the GIS and Performance working groups. This is expected to produce at least two informational drafts (due: 2002) (people: Dinda, Plale, Fisher, other GIS and Performance groups) Determine whether spinning off a working group is warranted (due: 2003) (people: in progress) In addition, the group may pursue the following goals: Define a set of use cases, producing informational draft (due: 2002) (people: in progress) pfoley@platform.com 14 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 Define a set of common "canned queries", producing informational draft (due: 2002) (people: in progress) Groups The European DataGrid's WP3 GMA Workpackage at RAL The Unified Relational GIS Project, jointly at Northwestern University and Indiana University The SCALEA Project at the University of Vienna Talks GMA and the relational data model - progress report, protocols, and where we might have strayed..., (Presented by Steve Fisher at GGF2), 2001, (pdf) A Unified Relational Approach to Grid Information Services (Presentation of White Paper), Peter Dinda and Beth Plale, March, 2001. (Presented by Peter Dinda at the First Global Grid Foruum) (powerpoint) LDAP Query Access: Challenges and Opportunities, Beth Plale and Peter Dinda, October, 2000. (Presented by Beth Plale at Grid Forum 5) (powerpoint) 4.8.5 Documents/Papers W. Hoschek, G. McCance, Grid Enabled Relational Database Middleware, Informational Draft (pdf) B. Coghlan, A Case for Relational GIS/GMA using Relaxed Consistency Grid Forum Informational Draft GWD-GP-11-1 (pdf) S. Fisher, Relational Model for Information and Monitoring, Grid Forum Informational Draft GWDGP-7-1 (pdf P. Dinda, B. Plale, A Unified Relational Approach to Grid Information Services, Grid Forum Informational Draft GWD-GIS-012-1 (pdf, ps). 4.8.6 4.9 History WG Sensor Management – Proposed No material found through GGF web site. 4.10 WG DAMED Discovery and Monitoring Event Description Proposed 27 Feb 2002 Alternate name suggested is Discovery and Monitoring Schema for Interoperability WG DMSI. 4.10.1 People Co-chair Jennifer Schopf Co-chair James Magowan Web-tsar Dan Gunter The list of interested parties who have volunteered their time (to date) includes: pfoley@platform.com 15 New Productivity Initiative WG Architectural Area Grid Forum for Dummies Dan Gunter, LBNL P. Foley Platform Computing May 2002 Bruce Lowekamp, College of William and Mary James Magowan, IBM, UK Manfred Oevers, IBM, UK Jennifer Schopf, ANL Warren Smith, NASA Martin Swany, UCSB Brian Tierney, LBNL 4.10.2 Contact Data Mailing list: damed-wg@gridforum.org (to subscribe, send an email with the subject (minus quotes) "subscribe damed-wg" to majordomo@gridforum.org) Web page: http://www-didc.lbl.gov/damed/ 4.10.3 Charter We propose a working group to define a basic set of monitoring event descriptions. These descriptions, or schemas, will describe the information (attributes) associated with a particular data element and will describe conventions for the representation of the value associated with it. The development of this sort of shared vocabulary is essential for interoperability among a growing number of testbeds and projects. This view is supported by the recent proliferation of independent efforts along these lines, both inside and outside the GGF. The aim of this group is to develop standard representations of the most widely used measurement values (the "top N".) From this we envision the emergence of a set of conventions and recommendations that will ease the task of defining richer, domain-specific schemas. 4.10.4 Goals and Milestones Milestones include: 1) Research existing schemas, draft of comparison of some schemas - Completion by April 2002 (currently in progress) 2) Develop "English" descriptions for the "top N" monitoring elements. This will not cover all future event schema needs, but will rather approach the intuitive subset that is in wide use today. - Completion by May 2002 3) Map English definitions to basic technologies including LDAP, SQL, XML. - Draft for discussion by GGF-5 4) Evaluate use of data models (for example relational, hierarchical, etc.) - Draft for discussion by GGF-5 5) Evaluate various data models in light of discovery of available monitoring data. Assuming a distributed infrastructure, mechanisms for discovery of events are non-trivial and various techniques in use will pfoley@platform.com 16 New Productivity Initiative WG Architectural Area Grid Forum for Dummies be compared. - Draft for discussion by fall 2002 P. Foley Platform Computing May 2002 6) Evaluate use of schema languages (e.g., GOS / XMLSchema / RDF / CIM) - Draft for discussion by fall 2002 4.10.5 Documents/Papers Top 'N' Events Strawman v.2 http://www-didc.lbl.gov/damed/documents/TopN_Events_version_2.html 4.10.6 History BOF presented at GGF4, Toronto, February 2002 Proposed Grid Benchmarking Research Group 4.11 RG Grid Benchmarking – Proposed 4.11.1 People Chair Rob Van der Wijngaart wijngaar@nas.nasa.gov 4.11.2 Contact Data 4.11.3 Charter 1. Proposed Grid Benchmarking Research Group Charter We will advance efficient usage of Grids by defining metrics to measure performance of Grid applications and architectures and rate functionality and efficiency of Grid architectures. These metrics should facilitate good engineering practices by allowing alternative implementations to be compared quantitatively. Also, they should provide Grid users with information about systems capabilities so that they can develop and tune their applications towards informed objectives. Therefore, we propose a set of tasks that assess Grid performance at the level of user applications. The tasks will be specified as paper-and-pencil benchmarks that can be implemented, in principle, using any of the existing and future Grid environments. We will also provide some reference implementations of the tasks that can be used by Grid users and developers as starting points for high-quality implementations. The tasks will be representative of the kinds of computations that are naturally suited for Grid environments, including data-intensive applications. Therefore, we will characterize existing and emerging Grid applications to understand and capture their computation needs and data usage patterns. The outcome will be a set of Grid benchmarking principles, as well as a set of benchmarks suitable for capturing the capability of Grids for performing distributed computations and for accessing data that may reside anywhere across a hierarchy of storage device, ranging from local disk to remote archival storage. Included will be performance tests to exercise a set of basic Grid services. pfoley@platform.com 17 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 The establishment of these benchmarks will help Grid users in choosing an appropriate Grid environment, and Grid designers to improve Grid performance. 4.11.4 Goals and Milestones 4.11.5 Documents/Papers 4.11.6 History pfoley@platform.com 18 New Productivity Initiative WG Architectural Area Grid Forum for Dummies 5 P. Foley Platform Computing May 2002 Security Area 5.1 WG GSI Grid Security Infrastructure 5.1.1 People WG Chair Von Welch welch@mcs.anl.gov Webmaster Von Welch welch@mcs.anl.gov Dan Duffy Daniel.Q.Duffy@erdc.usace.army.mil Wilbur Johnson Sandia 5.1.2 Contact Data 5.1.3 Charter Agenda for GGF4 Toronto CA, February 17-20 Description of GSI Working Group The purpose of the Grid Security Infrastructure (GSI) working group is to bring together anyone who is interested in the future of GSI, to help foster the continued specification and standardization of GSI, development of inter-operable GSI implementations, and widespread adoption of GSI as a security infrastructure for the Grid. This working group is writing a series of Grid Forum Drafts which together form a complete specification of GSI. These drafts include a combination of protocol and API specifications, along with a "GSI Roadmap" which ties the pieces together. Where appropriate, these drafts may also be submitted to the IETF for standardization. Working Group Drafts Grid Security Infrastructure (GSI) Roadmap (txt) (doc) Tuecke February 2001 An informational draft, providing an overview of GSI and the technical specifications that define GSI. Internet X.509 Public Key Infrastructure Proxy Certificate Profile Tuecke, Engert, Foster, Welch, Thompson, Pearlman, Kesselman March 2002 (Submitted to IETF) A technical specification draft of the X.509 certificate extensions required to support proxies, which is used for GSI single sign-on and delegation. Note that while this document has the same version as February 2002 version submitted to GGF4, it does have significant changes. GSS-API Extensions (pdf) (doc) Meder, Welch, Tuecke, Engert February 2002 pfoley@platform.com 19 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 A technical specification draft of GSS-API extensions, which are required for effective Grid programming using GSS-API. GSI Online Credential Retrieval - Requirements (pdf) (txt) (doc) Basney February 2002 This memo defines requirements for online credential retrieval services that provide secure access to X.509 credentials in the Grid Security Infrastructure (GSI). Multiple Credentials - Scenarios and Requirements (pdf) (doc) Butler, Engert, Jackson, Lorch, Welch February 2002 This document describes a number of scenarios where entities on Grid require multiple credentials. It details the requirements these scenarios place on the security infrastructure of the Grids. Akenti Restriction Language in X509 Proxy Certificates (txt) (doc) Thompson, Johnson, Mudumbai, Essiari July 2001 A technical specification draft of proxy restrictions in the language that is implemented by the Akenti Authorization service. Depreciated Documents TLS Delegation Protocol Jackson, Tuecke, Engert July 2001 A technical specification draft of TLS (SSL) protocol extensions to allow delegation of X.509 Proxy Certificates. Related Documents GSI Roadmap Introduction talk from Grid Forum 5 (October 2000) Related IETF documents Cryptographic Message Syntax (RFC 2630) Generic Security Service Application Program Interface, Version 2, Update 1 (RFC 2743) Generic Security Service API Version 2: C-bindings (RFC 2744) Independent Data Unit Protection Generic Security Service Application Program Interface (IDUPGSS-API) (RFC 2479) The Kerberos Network Authentication Service (V5) (RFC 1510) X.509 Internet Public Key Infrastructure Online Certificate Status Protocol – OCSP (RFC 2560) Internet X.509 Public Key Infrastructure, Certificate Management Protocols (RFC 2510) The Simple Public-Key GSS-API Mechanism (SPKM) (RFC 2025) The TLS Protocol, Version 1.0 (RFC 2246) pfoley@platform.com 20 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 Internet X.509 Public Key Infrastructure Certificate and CRL Profile (RFC 2459) NB eduPerson and gridPerson 5.2 5.2.1 WG GCP Grid Certificate Policy People Co-chair Randy Butler Tony Genovese Web tsar Tony Genovese Policy Team Randy Butler, Doug Engert, Tony Genovese, Peter Gietz, Mike Helm, John S. Hurley, Gareth Hughes, Marty Humphrey, Dave Kelsey, Mathilde Romberg, Mary Thompson, Von Welch 5.2.2 Contact Data This effort is under the Global Grid Forum's Security Area. Join the email list (security-wg) if you wish to participate in discussions and contribute to the development of the Grid Certificate Policies. Email list name security-wg@gridforum.org WebSite: http://GridCP.es.net 5.2.3 Charter The (GCP) Security Area works with international grid communities to develop a certificate policy that identifies and meets their requirements so that grid authentication certificates generated under this policy may be universally accepted among the grid community. For more information please visit the Security website. 5.2.4 Goals and Milestones 5.2.5 Documents/Papers Working Draft Documents and Outlines Grid CP Version 5 (PDF) GGF3 - Rome Italy (Meetting Canceled ) GGF2 - Washington DC (Documents, minutes, etc.) Public Key Technology Policy Requirements for Grid Identification pfoley@platform.com 21 New Productivity Initiative WG Architectural Area Grid Forum for Dummies Background Documents P. Foley Platform Computing May 2002 Auditing "How do you trust a Certificate Authority" By Alfred Van Ranst, Jr. WebTrust Program for Certification Authorities WebTrust Guide (Word, PDF) Models/Templates/Glossaries RFC 2527, Internet X.509 Public Key Infrastructure Certificate Policy and Certification Practices Framework. (text) Model Certificate Policy - used by Federal Bridge USA (Word) Terms from RFC 2527 and Model certificate Policy (Word, PDF) Internet Security Glossary: RFC 2828 (HTML) Existing CP's INFN CA Policy and CPS National Computational Science Alliance Certificate Policy (Word, HTML) X.509 Certificate Policy for the Federal Bridge Certification Authority (Word) The DFN-PCA CA policy (PDF) The UNICORE CA policy (PDF) Certification Practice Statement for the SURFnet PCA, using RFC 2527 (HTML) EuroPKI CP local draft 4 (PDF) Next... 5.2.6 6 History Scheduling and Resource Management Area 6.1.1 People Co-lead Bill Nitzberg Co-lead Jennifer Schopf bill@computer.org 6.1.2 Charter Generate best practice scheduling and resource management documents, protocols, and API specifications to enable interoperability. pfoley@platform.com 22 New Productivity Initiative WG Architectural Area Grid Forum for Dummies 6.1.3 Goals and Milestones P. Foley Platform Computing May 2002 6.1.4 Documents/Papers SchedWD8 "Super Scheduler Steps/Framework", J. Schopf, 7/01 overview of current user practices for scheduling across administrative domains SchedWD8.5.doc, SchedWD8.5.pdf, Status: Under final comment period SchedWD9 "Advanced Reservation API", Roy and Sander, 7/01 Proposed standard API for advance reservations SchedWD.9.4.doc, SchedWD.9.4.pdf, based on previous WD 4,5, and 7 Status: updated 7/01, final comment period SchedWD10 Attributes for communication about scheduling instances(formerly Grid Scheduling Tokens), Schwiegelshohn and Yahyapour, Topic: tokens needed to describe local schedulers 9/01 version SchedWD.10.5.pdf, SchedWD.10.5.doc status: updated 9/01, to be discussed at GGF-3 SchedWD12 Grid Resource Management Topic: Requirements for a grid resource management protocol 9/01 version SchedWD.12.1.pdf, status: to be discussed at GGF-3 SchedWD13 qprep: A facility independent tool for job submission Topic: a command line API for job submission 9/01 version SchedWD.13.1.pdf, status: to be discussed at GGF-3 in a BOF General Meeting Notes Overview of SRM Area for GGF-4, in pdf format Other GGF-4 notes October 01 Overview of SRM Area for AP GGF Workshop, October 2001, in pdf format October 01 Third Global Grid Forum Meeting, Frascati, Italy .pdf, .ppt July 01 Second Global Grid Forum Meeting, Washington, DC .pdf, .ppt March 01 First Global Grid Forum Meeting, Amsterdam, Netherlands .pdf, .ppt October 00 5th Grid Forum Meeting", Sun Microsystems, Marlboro MA .pdf, .ppt pfoley@platform.com 23 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 July 00 4th Grid Forum Meeting", Microsoft Campus, Redmond WA .pdf, .ppt March 00 3rd Grid Forum Meeting", UCSD, San Diego, CA. .pdf, .ppt, Summary sent in email Oct 1999: [pdf] "2nd Grid Forum Meeting", Northwestern University, Chicago, IL. Aug 1999: [pdf] "Grid Forum BOF - Impromptu Gathering", HPDC-8, Redondo Beach, CA. Aug 1999: "Grid Forum BOF - Super Scheduler Notes, HPDC-8, Redondo Beach, CA. Jun 1999: [pdf] "1st Grid Forum Meeting", NASA Ames, Mountain View, CA. Related Links [If you would like a link added to this list, please send me the one line version.] Global Grid Forum Advance Reservation & Co-scheduling Workshop, May 11, 1999. IPDPS Workshops on Job Scheduling Strategies for Parallel Processing Dror's Scheduling taxonomy (ps.gz) Parallel Workloads Archive maintained by Dror Feitelson PSCHED: API Standards for Parallel Job/Resource Scheduling (somewhat inactive) Portable Batch System (PBS) 6.1.5 6.2 History WG Advanced Reservation ‘Empty-room’ group. Link on GGF web site summary table is to Scheduling Attributes group. 6.3 WG GRM Grid Resource Management http://www.mcs.anl.gov/~jms/ggf-sched/WG/grm-wg.html 6.3.1 People Chair Bill Nitzberg bill@computer.org 6.3.2 Contact Data Email list: sched-wg@gridforum.org Info about maillist and archives Web page: http://www.mcs.anl.gov/~jms/ggf-sched/WG/grm-wg.html pfoley@platform.com 24 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 6.3.3 Charter This working group has the goal to produce a set of documents describing a common resource management protocol for Grid environments. 6.3.4 Goals and Milestones 6.3.5 Documents/Papers Current Document 9/01 version, SchedWD.12.1.pdf Document History for SchedWD12 Title: Grid Resource Management Protocol: Requirements Authors: Czajkowski, Sander Topic: Main considerations in defining a standard Grid Resource Management (RM) Protocol to connect agents or clients to resource managers 9/01 version, SchedWD.12.1.pdf Status: To be discussed at GGF-3 Milestones (including past): 6.3.6 6.4 6.4.1 History WG SG Scheduler Attributes People Chair Uwe Schwiegelshohn Uwe.Schwiegelshohn@udo.edu 6.4.2 Contact Data Email list: sched-wg@gridforum.org Info about maillist and archives Web page: http://www.mcs.anl.gov/~jms/ggf-sched/WG/sa-wg.html Charter: Current Document 9/01, SchedWD.10.5.pdf, SchedWD.10.5.doc` Document History for SchedWD10 pfoley@platform.com 25 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 Title: Attributes for Communication between Scheduling Instances (formerly Grid Scheduling Tokens) Authors: Schwiegelshohn and Yahyapour Topic: tokens needed to describe local schedulers 1/01 version SchedWD10.pdf, SchedWD10.doc 2/01 version SchedWD 10.1.doc, (.pdf) 6/01 version SchedWD.10.2.pdf, SchedWD.10.2.doc, 7/01 version SchedWD.10.3.pdf, SchedWD.10.3.doc, 9/01 version SchedWD.10.4.pdf, SchedWD.10.4.doc` 9/01 version 2 SchedWD.10.5.pdf, SchedWD.10.5.doc` Status: Updated and ready for discussion at GGF-3 Milestones (including past): 1. Initiation GF 5 2. First draft and telecon discussion between GF 5 and GGF 1 3. First plenary discussion GGF 1 4. First revision and telecon discussion between GGF 1 and GGF 2 5. Second plenary discussion GGF 2 6. Second revision (8/31/01) and telecon discussion (9/19/01) between GGF 2 and GGF 3 7. Third and final plenary discussion GGF 3 8. Final revision (11/15/01) and telecon discussion (xx/12/01) 9. 30 day review period (January 02) 6.4.3 Charter This working group has the goal to produce a document defining attributes for the communication between different scheduling instances in grid environment. 6.4.4 Goals and Milestones Milestones (including past): 1. Initiation GF 5 2. First draft and telecon discussion between GF 5 and GGF 1 3. First plenary discussion GGF 1 4. First revision and telecon discussion between GGF 1 and GGF 2 5. Second plenary discussion GGF 2 6. Second revision (8/31/01) and telecon discussion (9/19/01) between GGF 2 and GGF 3 7. Third and final plenary discussion GGF 3 8. Final revision (11/15/01) and telecon discussion (xx/12/01) 9. 30 day review period (January 02) pfoley@platform.com 26 New Productivity Initiative WG Architectural Area Grid Forum for Dummies 6.4.5 Documents/Papers Current Document P. Foley Platform Computing May 2002 9/01, SchedWD.10.5.pdf, SchedWD.10.5.doc` Document History for SchedWD10 Title: Attributes for Communication between Scheduling Instances (formerly Grid Scheduling Tokens) Authors: Schwiegelshohn and Yahyapour Topic: tokens needed to describe local schedulers 1/01 version SchedWD10.pdf, SchedWD10.doc 2/01 version SchedWD 10.1.doc, (.pdf) 6/01 version SchedWD.10.2.pdf, SchedWD.10.2.doc, 7/01 version SchedWD.10.3.pdf, SchedWD.10.3.doc, 9/01 version SchedWD.10.4.pdf, SchedWD.10.4.doc` 9/01 version 2 SchedWD.10.5.pdf, SchedWD.10.5.doc` Status: Updated and ready for discussion at GGF-3 6.4.6 6.5 6.5.1 History WG SD Scheduling Dictionary People Co-chair Mary Roehrig mroehr@sandia.gov Co-chair Wolfgang Ziegler Wolfgang.Ziegler@scai.fraunhofer.de 6.5.2 Contact Data http://www.mcs.anl.gov/~jms/ggf-sched/WG/sd-wg.html 6.5.3 Charter Focus/Purpose: Create a dictionary to define common terms used by various schedulers, both local and grid-level. Collect scheduling queries or tokens, and set up an overall inventory of those terms and keywords a user needs to specify when interacting with a scheduler. Set priorities, sort this list, and finally describe details, definitions, and use of the terms. Scope: Initially, the scope of this activity will be those schedulers supported by Globus. Additional schedulers may be added as the Working Group becomes aware of those commonly used by Global Grid Forum members. pfoley@platform.com 27 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 6.5.4 Goals and Milestones Goals: The objective of this Working Group is to support and enhance interoperability between different scheduling systems by providing a summary of terminology encountered with various schedulers. This information could then be used to develop a grid language that would provide seamless communication and advanced reservation capabilities to the various schedulers in use within a Grid. Milestones (including past): End of January 2002: First condensed, sorted, and prioritised list available for refinement in further WG discussions GGF-4 WG meeting: Agreed list available, plan for further work set up GGF-5 WG meeting: First draft of definition and use of terms GGF-6 WG meeting; Final version of scheduling dictionary 6.5.5 Documents/Papers Current Document none Document History Title: none Authors: none Topic: none Status: To be discussed at GGF-3 6.5.6 6.6 6.6.1 History WG DRMAA Distributed Resource Management Application API People Co-chair John Tollefsrud j.t@sun.com, Co-chair Hrabri Rajic hrabri.rajic@intel.com 6.6.2 Contact Data Email list: sched-wg@gridforum.org Info about maillist and archives Web page: http://www.mcs.anl.gov/~jms/ggf-sched/WG/drmaa-wg.html pfoley@platform.com 28 New Productivity Initiative WG Architectural Area Grid Forum for Dummies Proposed Charter: P. Foley Platform Computing May 2002 6.6.3 Charter Develop an API specification for the submission and control of jobs to one or more Distributed Resource Management (DRM) systems. The scope of this specification is all the high level functionality which is necessary for an application to consign a job to a DRM system including common operations on jobs like termination or suspension. 6.6.4 Goals and Milestones The objective is to facilitate the direct interfacing of applications to today's DRM systems by application's builders, portal builders, and Independent Software Vendors (ISVs). Milestones (including past): Oct 2001: DRMAA BOF at GGF3 (completed) Dec 2001: DRMAA WG status Jul 2002: DRMAA v1.0 GWD submitted for review 6.6.5 Documents/Papers Document History DRMAA BOF at GGF3 proposal for the interface specification (v0.1) Status: The group has distributed the proposed charter shown above to the GGF scheduler area mail list recipients and is awaiting comments. Baring unfavorable comments, a request will be made December 4, 2001 to the scheduling area cochairs to seek GGF steering committee approval for the DRMAA WG. The group would like to schedule two teleconferences in advance of GGF4 to begin discussions. The planned schedule of conference calls is: Dec 11, 9:00am, PST Jan 8, 9:00am, PST Anyone interested in participating should use the following information to reach these two conference calls: PARTICIPANT CODE: 691169 Toll Free Dial In Number: (877)288-4427 At the GGF4 meeting Feb 17-20 in Toronto, we would like to hold a Working Group session to sufficiently define a first draft of a specification. 6.6.6 6.7 6.7.1 History RG OPT Scheduler Optimization - Proposed People Co-chair Vincenzo DiMartino pfoley@platform.com v.dimartino@caspur.it 29 New Productivity Initiative WG Architectural Area Grid Forum for Dummies Co-chair Marco Mililotti P. Foley Platform Computing May 2002 m.mililotti@caspur.it 6.7.2 Contact Data http://www.caspur.it/~vincenzo/GGF_SRM_OPT.html 6.7.3 Charter The aim of the SRM-OPT research group is the investigation of the available scheduling techniques in the framework of the GRID infrastructure. The activity should include: theoretical study; case study simulation; real interface to active GRID (existing and/or future) tools. An optimization process require that some flexibility is plugged in the system to have the opportunity to choose different job submission paths or strategy. The optimization of the job allocation with respect to specific constraints is a key research problem. 6.7.4 Goals and Milestones The first goal is to study a flexible environment to permit a feasible optimization during the scheduling process. The RG long term goal is to study the integration of an optimization module in the existing scheduling systems. Milestones Feb 2002: First Research Group participant consolidation. Jul 2002: Collection and production of papers describing critical aspects. Dec 2002: Analysis of preliminary results. 6.7.5 Documents/Papers BOF Meeting At the GGF-3 a scheduling optimization BOF has been held on Tuersday, 9 october 2001 Goals Revision Process All the sched-wg mailing list members are invited to post their comments addenda etc, the final version will be submitted to the GGF steering group. -------------------------------------------------------------------------------Vincenzo Di Martino ( 6.7.6 6.8 History WG SCLA Scheduler Command Line API - Proposed Scheduling Command Line API Working Group (SCLA) Global Grid Forum, Scheduling and Resource Management Area 6.8.1 People pfoley@platform.com 30 New Productivity Initiative WG Architectural Area Grid Forum for Dummies Co chair Joe Werne P. Foley Platform Computing May 2002 werne@colorado-research.com Co chair jms@mcs.anl.gov Jennifer Schopf 6.8.2 Contact Data Email list: sched-wg@gridforum.org Info about maillist and archives Web page: http://www.mcs.anl.gov/~jms/ggf-sched/WG/scla-wg.html 6.8.3 Charter Standardizing a command line interface to schedulers This group will present a BOF at GGF-3. 6.8.4 Goals and Milestones 6.8.5 Documents/Papers Current Document 9/01 version, SchedWD.13.1.pdf Document History for SchedWD13 Title: qprep: A facility independent tool, for job submission Authors: Werne, Bizon, Gourlay Topic: This document specifies a command line API, qprep, for facility-independent job submission. 9/01 version, SchedWD.13.1.pdf Status: This group will present a BOF at ggf-3 Milestones (including past): 6.8.6 7 History Architecture Area 7.1.1 People Director William Johnston wejohnston@lbl.gov Director Jeffrey Nick jnick@us.ibm.com pfoley@platform.com 31 New Productivity Initiative WG Architectural Area Grid Forum for Dummies 7.2 P. Foley Platform Computing May 2002 WG JINI 7.2.1 People Co chair Vladimir Getov v.s.getov@westminster.ac.uk Co chair Omer Rana o.f.rana@cs.ac.uk Co chair Eric Sharakan eric.sharakan@east.sun.com 7.2.2 Contact Data A. Mailing List and Website An archived mailing list has been set up for this proposed working group, to enable participants to discuss issues of interest. Any interested parties may join the mailing list by sending a message to: majordomo@gridforum.org With message body subscribe jini-activity The group's website is at http://www.mcs.anl.gov/gridforum/jini/ 7.2.3 Charter B. Description This working group is being established to address two concerns raised by the Grid computing community: • B.1. The ability to support both resource and service discovery within a single framework, enabling information services to register and leave dynamically, within a Grid environment. Such information services can be application specific, or they be generic, supporting multiple applications to coexist within the same environment. The ability to identify which new services are available, where they exist, and how to invoke them, are all important criteria to enable a Grid to function. Service providers within Grid environments are likely to utilise proprietary protocols to enable peer-to-peer or client-server interaction. Consequently, in this context, support within the infrastructure to enable such diverse protocols to co-exist is important. We also aim to investigate what common infrastructure is necessary, to enable multiple such application specific or vendor specific protocols to co-exist. pfoley@platform.com 32 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 • B.2. Investigate ways in which the Jini philosophy and technology can be used as an infrastructure within Grid environments to support the requirements identified in (1) above. Jini provides an important new development in supporting platform and OS heterogeneity (due to its Java centric nature), and enable information services to be registered locally, but accessed remotely, based on a federated architecture. The ability to concentrate on a specific API will enable a concrete investigation of service discovery and management, and help us identify particular deficiencies in utilising an API of this kind. The Jini technology utilises code migration techniques, to enable different wire line protocols between client and servers, or between peers, to co-exist, and this may be of particular benefit in a Grid environment in order to support a range of different proprietary and legacy applications. 7.2.4 Goals and Milestones Establish collaboration and synergy with expertise from JavaGrande, GridForum and ComputingPortals working groups Investigate ways in which Jini can be used as infrastructure within Grid environments, and to identify deficiencies in Jini that may need to be overcome. Deficiencies relate to aspects of security, and system scalability, for instance Investigate Jini services such as: Leasing, Transactions, Inter-domain security and access control lists, Fuzzy pattern matching, Service discovery Resource management Scalability of Jini infrastructure and performance to support Grid enabled applications Work on prototype implementations -- developing prototypes to demonstrate concepts will be essential to participate in the group Provide resources and seminars on Jini for members of the working group Identify current work within the Jini community, and overlaps between requirements and impacts on Grid applications and environments Investigate issues in deployment and use of Jini This is an open working group and we are looking for a broad participation of the community, including academia and industry 7.2.5 Documents/Papers Presentations GridForum 5 Presentations - Boston, October 2000 pfoley@platform.com 33 New Productivity Initiative WG Architectural Area Grid Forum for Dummies Themes of Group P. Foley Platform Computing May 2002 Jini Technology and Distributed Resource Management: a Technology Exploration (Eric Sharakan) Fifth Jini Community Meeting - Amsterdam, December 2000 Grid Forum Jini Activity (Martha Kahn) The DARPA CoABS Grid -- Jini Performance Experiments (Martha Kahn) Global Grid Forum Presentations - Amsterdam, March 2001 Introduction and Charter (Vladimir Getov) JiniGrid (Mark Parsons) JiPANG: Jini-based Computing Portal System (Toyotaro Suzumura and Dennis Gannon) Grids Research at C3.ca (Roger Impey) Environment for Federated Computational Communities (Steven Newhouse) Projects MPIJava at Flordia State University Control of Agent Based Systems at Global InfoTek Nalu Project at the Maui HPCC Ronin at UMBC Java and High End Computing at Hostway Corp. The JiniGrid Project at EPCC Jini Infrastructure to support Java message passing at Portsmouth University JAM: Job and Applications Manager Sun/CSCS A Framework for Opportunistic Cluster Computing using JavaSpaces Rutgers University Component Software and Grid Middleware Imperial College JavaWulf Project Sun Microsystems, Switzerland Jini Resources Jini.org Jini Resources on the net Jini Academic Portal JXTA (peer to peer computing) GridForum 5 Presentations - Boston, October 2000 Themes of Group Jini Technology and Distributed Resource Management: a Technology Exploration (Eric Sharakan) Fifth Jini Community Meeting - Amsterdam, December 2000 Grid Forum Jini Activity (Martha Kahn) The DARPA CoABS Grid -- Jini Performance Experiments (Martha Kahn) pfoley@platform.com 34 New Productivity Initiative WG Architectural Area Grid Forum for Dummies Global Grid Forum Presentations - Amsterdam, March 2001 P. Foley Platform Computing May 2002 Introduction and Charter (Vladimir Getov) JiniGrid (Mark Parsons) JiPANG: Jini-based Computing Portal System (Toyotaro Suzumura and Dennis Gannon) Grids Research at C3.ca (Roger Impey) Environment for Federated Computational Communities (Steven Newhouse) Projects MPIJava at Flordia State University Control of Agent Based Systems at Global InfoTek Nalu Project at the Maui HPCC Ronin at UMBC Java and High End Computing at Hostway Corp. The JiniGrid Project at EPCC Jini Infrastructure to support Java message passing at Portsmouth University JAM: Job and Applications Manager Sun/CSCS A Framework for Opportunistic Cluster Computing using JavaSpaces Rutgers University Component Software and Grid Middleware Imperial College JavaWulf Project Sun Microsystems, Switzerland Jini Resources Jini.org Jini Resources on the net Jini Academic Portal JXTA (peer to peer computing) 7.2.6 7.3 7.3.1 Chair History WG NPIA NPi Architecture People Darren Pulsipher pfoley@platform.com darrenp@cadence.com 35 New Productivity Initiative WG Architectural Area Grid Forum for Dummies 7.3.2 Contact Data 7.3.3 Charter 7.3.4 Goals and Milestones 7.3.5 Documents/Papers 7.3.6 History 7.4 7.4.1 P. Foley Platform Computing May 2002 WG OGSI Open Grid Services Infrastructure People Co-chair Jeff Frey jafrey@ibm.com Co-chair Steve Tuecke tuecke@mcs.anl.gov Webmaster Steve Tuecke tuecke@mcs.anl.gov 7.4.2 Contact Data General Discussion Email: ogsi-wg@gridforum.org Email Archive: http://www-unix.gridforum.org/mail_archive/ogsi-wg/maillist.html Web Site: http://www.gridforum.org/ogsi-wg Bugzilla Database: http://www.gridforum.org/ogsi-wg/bugzilla To subscribe to our email list, send email to majordomo@gridforum.org with the body "subscribe ogsi-wg". Do not include the quotation marks. You must be a member of an email list to post to it. If you subscribe to a the working group list please be sure to also subscribe to the GGF general list (grid-announce@gridforum.org). To do this, send email to majordomo@gridforum.org with "subscribe grid-announce" as a single line in the message body. 7.4.3 Charter The objective of the OGSI Working Group is to review and refine the Grid Service Specification and other documents that derive from this specification, including Open Grid Service Architecture (OGSA) infrastructure-related technical specifications and supporting informational documents. 7.4.4 Goals and Milestones 7.4.5 Documents/Papers The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration Grid Service Specification pfoley@platform.com 36 New Productivity Initiative WG Architectural Area Grid Forum for Dummies 7.4.6 History 7.5 7.5.1 P. Foley Platform Computing May 2002 RG GPA Grid Protocol Architecture People Co-chair William Johnston wejohnston@lbl.gov Co-chair Ian Foster itf@mcs.anl.gov Co-chair Reagan W. Moore moore@sdsc.edu 7.5.2 Contact Data Organization and Mailing List Mailing List: gpa-wg@gridforum.org; Subscription Request: send an email to majordomo@gridforum.org with the body "subscribe gpa-wg" Web Site: Home Page : http://grid.lbl.gov/GPA Email Archive: http://www-unix.gridforum.org/mail_archive/gpa-wg/maillist.html 7.5.3 Charter The role of the Grid Protocol Architecture Working Group is to provide a conceptual framework for discussing the interrelationships, completeness, and minimality of the protocol approach to Grid services that is coming out of GF. 7.5.4 Goals and Milestones produce an overview architecture to provide a starting point explore the issue of different "views" of Grids establish a methodology for representing the architecture document the relationship of the the GGF architecture to other, existing Grid-like architectures from outside GGF evolve the initial overview architecture 7.5.5 Documents/Papers Meeting Minutes and Notes GGF-3 (Frascati, Italy) Notes and proposed Charter and Milestones. (ppt) (pdf) "More thoughts on Architecture and Evolution" - Steve Fisher (ppt) (pdf) "Knowledge-Based Grids: Two Use Cases" - Reagan W. Moore (ppt) (pdf) Supporting Material pfoley@platform.com 37 New Productivity Initiative WG Architectural Area Grid Forum for Dummies Data Management Systems. Moore, et al. P. Foley Platform Computing May 2002 ( ppt) (pdf) The Anatomy of the Grid: Enabling Scalable Virtual Organizations. I. Foster, C. Kesselman, S. Tuecke, (to be published in Intl. J. Supercomputer Applications, 2001). Defines Grid computing and the associated research field, proposes a Grid architecture, and discusses the relationships between Grid technologies and other contemporary technologies. GGF-1 presentation, including some sample architectures. ( ppt) (pdf) Example Architectures. ( ppt) (pdf) Use-Cases. Grid Protocol Architecture Working Group Home I. Organization and Mailing List Email Archive: http://www-unix.gridforum.org/mail_archive/gpa-wg/maillist.html IV. Milestones See GGF-3 notes, below. V. Meeting Minutes and Notes GGF-3 (Frascati, Italy) Notes and proposed Charter and Milestones. (ppt) (pdf) "More thoughts on Architecture and Evolution" - Steve Fisher (ppt) (pdf) "Knowledge-Based Grids: Two Use Cases" - Reagan W. Moore (ppt) (pdf) GGF-4 (Toronto, Canada) Meeting presentation. (MS PowerPoint) Meeting notes. (MS Word)) VI. Supporting Material Data Management Systems. Moore, et al. ( ppt) (pdf) The Anatomy of the Grid: Enabling Scalable Virtual Organizations. I. Foster, C. Kesselman, S. Tuecke, (to be published in Intl. J. Supercomputer Applications, 2001). Defines Grid computing and the associated research field, proposes a Grid architecture, and discusses the relationships between Grid technologies and other contemporary technologies. GGF-1 presentation, including some sample architectures. ( ppt) (pdf) Example Architectures. 7.5.6 7.6 History RG ACCT Accounting Models 7.6.1 People Co-chair Bill Thigpen pfoley@platform.com thigpen@nas.nasa.gov 38 New Productivity Initiative WG Architectural Area Grid Forum for Dummies Co-chair Tom Hacker P. Foley Platform Computing May 2002 hacker@umich.edu 7.6.2 Contact Data Email list name: accounts-wg@gridforum.org WebSite: http://www.nas.nasa.gov/~thigpen/accounts-wg 7.6.3 Charter The purpose of the Account Models research group is to (a) develop a prototype grid accounting architecture such as is required for resource economies, (b) define interactions with other grid components and existing systems, and (c) create a specification that can be used to build and evaluate prototype systems. General Overview The Distributed Accounting Working Group is responsible for identifying needed account and accounting information, determining the needed mechanisms to pass this information, work with agencies (universities and corporations) to ensure the needs of all represented agencies are addressed and document this information to facilitate reference implementations of these specifications. Another purpose of this group is to provide a collaborative forum to facilitate joint efforts between organizations. The DAWG was formed to identify and solve problems associated with account management across the Grid environment. The focus of the group is summarized in the four following statements: 7.6.4 Goals and Milestones Develop a straw-man grid accounting architecture Define other interactions with grid components and existing systems minimizing the impact Create a specification that could be used to build and evaluate distributed accounting prototypes Identify agency/university/corporate concerns that must be addressed and recommend solutions. In particular, concerns include sharing resources in an open Grid environment, and managing Grid use of their resources 7.6.5 Documents/Papers Account Allocations on the Grid An Economy Grid Architecture for Service-Oriented Grid Computing Distributed Accounting on the Grid Distributed Accounting Working Group (DAWG) Charter Resource Accounting - Current Practices Simplifying Administration and Management Processes in the Polish National Cluster pfoley@platform.com 39 New Productivity Initiative WG Architectural Area Grid Forum for Dummies 7.6.6 History 7.7 P. Foley Platform Computing May 2002 WG Accounting Record Format – Proposed No material found through the GGF Web site. 7.8 WG Open Source Software Licensing – Proposed 7.8.1 People 7.8.2 Contact Data 7.8.3 Charter 7.8.4 Goals and Milestones 7.8.5 Documents/Papers 7.8.6 History 7.9 7.9.1 RG Grid Economies – Proposed People pfoley@platform.com 40 New Productivity Initiative WG Architectural Area Grid Forum for Dummies 7.9.2 Contact Data 7.9.3 Charter 7.9.4 Goals and Milestones 7.9.5 Documents/Papers 7.9.6 History P. Foley Platform Computing May 2002 7.10 SGNP WG Proposed 1 March 2002 -----Original Message----From: Andrew Grimshaw [mailto:grimshaw@virginia.edu] Sent: Friday, March 01, 2002 4:03 PM To: gfsg@gridforum.org Subject: SGNP working group All, Yet another WG proposal. Secure Grid Naming Protocol Working Group Area: Architecture Background: At GGF 4 a BOF was held on the topic of naming in grids. The SGNP was presented as a GWDR at that time. Over twenty people attended the BOF. A majority of those attending agreed that a working group should be formed. Charter: Address at an early stage of architectural definition the critical aspects of naming and binding in grids. Specifically to review the proposed SGNP specification, seek additional input from the community and potential users, and produce a SGNP specification to present to the GGF for approval. Chair(s): Andrew Grimshaw Initial documents: pfoley@platform.com 41 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 A copy of the draft proposal for a Secure Grid Naming Protocol (SGNP) is available at the following location on the GGF site: http://www.globalgridforum.org/Meetings/GGF4/bofs/SGNP%20-%20GWD-R%202002.02.05.pdf Quick details: The document proposes a Secure Grid Naming Protocol (SGNP), which introduces a straightforward approach to identifying resources that participate in Grid systems. The SGNP addresses the stringent requirements of large-scale, dynamic Grid systems, namely: a global namespace, spanning multiple locations and administrative domains; secure communication capabilities among resources and services without requiring a central trusted authority; location transparency capabilities such that resources and services can continue communicating with one another even if one or both happen to move, fail, restart, be located on heterogeneous platforms, OS's, etc. These requirements have not thus far been fully addressed by other naming approaches. Most importantly, SGNP does not introduce the need for a central trusted authority, thus enabling the creation of scalable Grid systems and facilitating a variety of practical models for Grid administration. 8 Data Area Data handling systems provide the mechanisms needed to support distributed data access across heterogeneous data resources in computational grids and data grids. The requirements for a data handling system can be expressed as "transparencies" that hide grid implementation details, including data set name transparency, data location transparency, access protocol transparency, time transparency or data access optimization, and authentication transparency or single sign-on systems. The GGF Data Access Area will seek common implementation practices for integrating software systems that provide the listed capabilities. 8.1.1 Documents/Papers Survey: A Component-based Middleware for Data-intensive Computing in the Grid - DataCutter Architecture: An Architecture for Replica Management in Grid Computing Environments Survey: Architectures used by the Remote Data Access Systems Survey: Caching Models Survey: Data Grids Survey: GriPhyN, Advancing Data-Intensive Science Survey: Hierarchical Distributed Replica Catalogues Survey: Low Level Data Access APIs Survey: Naming and Information Management used by Remote Data Access Systems Survey: Remote Data Access Dictionary Requirements: Requirements for Scheduling of Storage Systems pfoley@platform.com 42 New Productivity Initiative WG Architectural Area Grid Forum for Dummies Survey: Security Mechanisms used by the Remote Data Access Systems P. Foley Platform Computing May 2002 Survey: The Internet Backplane Project Best Practice: Tuning Guide for Distributed Applications 8.2 WG GridFTP GridFTP Grid Data Data handling systems provide the mechanisms needed to support distributed data access across heterogeneous data resources in computational grids and data grids. The requirements for a data handling system can be expressed as "transparencies" that hide grid implementation details, including data set name transparency, data location transparency, access protocol transparency, time transparency or data access optimization, and authentication transparency or single sign-on systems. The GGF Data Access Area will seek common implementation practices for integrating software systems that provide the listed capabilities. 8.2.1 People Chair is Bill Allcock (allcock@mcs.anl.gov), link from GGF web site jumps directly into a technical overview of the GridFTP area. GGF administrative details and charter are not found through this link. 8.3 8.3.1 WG GDWG Grid Databases People Co-chair Leanne Guy Leanne.Guy@cern.ch Co-chair Norman Paton norm@cs.man.ac.uk Co-chair Dave Pearson dave.pearson@oracle.com 8.3.2 Contact Data The BOF website is: http://www.cs.man.ac.uk/grid-db . 8.3.3 Charter Research and development activities relating to the Grid have generally focused on applications where data is stored in files. However, in many scientific and commercial domains, database management systems have a central role in data storage, access, organisation, authorisation, etc, for numerous applications. The group seeks to promote standards for the development of grid database services, focusing principally on providing consistent access to existing, autonomously managed databases. By focusing on services, the intention is to ease application development through the provision of composable components, and to track developments in the Open Grid Services Architecture (OGSA). The group does not seek to develop new data storage systems, but rather to make such systems more readily usable individually or collectively within a Grid framework. 8.3.4 Goals and Milestones The goals of the group are as follows: pfoley@platform.com 43 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 To identify and document the requirements of database and information management applications within a Grid setting. To develop a roadmap for research and development of database services for use within Grid middleware. To work with other groups within the GGF to ensure that the roadmap proposal conforms with emerging Grid standards. To foster the development of reference implementations of Grid database services. In operating as a Working Group rather than a Research Group, the aim is to scope the activities of the group in such a way that detailed designs and reference implementations can be carried out within a 24 month timeframe. The associated milestones are as follows: Requirements identification: February 2002: Draft Requirements Document based on visits to existing Grid projects [tabled at BoF]. July 2002: Final Requirements Document based on further visits and feedback on earlier release. Services Document: February 2002: Draft document outlining nature and scope of grid database access and integration services [tabled at BoF]. July 2002: Revised database services document, in the light of preliminary implementation experience and continuing requirements gathering. Implementation priorities identified. December 2002: Final database services document. Roadmap Document: May 2002: Preliminary roadmap for development of Grid database services - broad scope, but principally to attract feedback. July 2002: Revised roadmap for Grid database services - clear short-term plans, and longer term position principally for discussion. December 2002: Final roadmap for Grid database services. Coordination with other Groups: This will report back in the context of the services document, where an appendix will make explicit both the dependencies on and consequences for other Groups of the ongoing database activity. Reference implementations: These will track the roadmap proposal. In practice, we anticipate that work on reference implementations will run in parallel with the development of the services document. We envisage software releases support the services at least on a 6 monthly basis from July 2002. 8.3.5 Documents/Papers 8.3.6 History Charter approved 26 April 2002 BOF presented at GGF4, Toronto, February 2002 8.4 RG Persistent Archives Chair is Reagan Moore (SDSC), no other information is found on the GGF web site. pfoley@platform.com 44 New Productivity Initiative WG Architectural Area Grid Forum for Dummies 8.5 RG Data Replication P. Foley Platform Computing May 2002 Chair is Ann Chervenak (ISI), no other information is found on the GGF web site. 8.6 WG Archiving Command Line API – Proposed Listed in Catlett’s Proposed GGF Group document (March 2002), no other references found through the GGF web site. 8.7 RG DataGrid Schema – Proposed Listed in Catlett’s Proposed GGF Group document (March 2002), no other references found through the GGF web site. 8.8 RG Application Metadata – Proposed Listed in Catlett’s Proposed GGF Group document (March 2002), no other references found through the GGF web site. How is this related to the Distributed Applications Metadata group in the Applications, Programming Models and Environments Area? 8.9 RG Network Storage – Proposed Chair is Micah Beck (mbeck@cs.utk.edu), no other information is found on the GGF web site. 9 Applications, Programming Models & Environments Area 9.1.1 People 9.1.2 Contact Data 9.1.3 Charter 9.1.4 Goals and Milestones 9.1.5 Documents/Papers Grid Advanced Programming Models There is increasing interest in the use of networks not just for communication or remote data access, but also for the coupling of computers, instruments, data archives, etc., with each other and with humans. Some of these applications include collaborative environments, distributed computing, computer-enhanced instrumentation, distributed data mining, digital libraries, and problem solving environments. Within the scientific community, this interest has led to new initiatives such as the NASA Information Power Grid, NCSA Alliance National Technology Grid, NPACI metasystems, DOE Collaboratories, DOE ASCI DISCOM, etc., as well as the establishment of focused community forums concerned with, for example, the use of Java for high-performance computing (Java pfoley@platform.com 45 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 Grande Forum), desktop access to remote resources (DATORR), component architectures, (CCA Forum), etc. For more information please visit their website. Area News & Updates: Laforenza's Invited Talk at Euro PVM/MPI 2001 (postponed) incorporates many concepts from A Grid Programming Primer Some Possible GWD Topics Grid Messaging Metadata Schema RPC Client-Server Metadata Schema Messaging Security Domains Fault Tolerance Models for Grid Messaging Services Associative Grid Messaging Services RPC Fault Scenarios Unified Grid Event Representations Event/RPC Registry and Discovery Services Multimode Communication Models and Break-even Criteria Discussion List: To subscribe to the models-wg discussion list for the Advanced Programming Models working group of the Grid Forum, please send the following command "subscribe modelswg" in email to majordomo@gridforum.org Discussion List Thread Index Discussion List Mail Index Organization The Grid Forum's Advanced Programming Models working group was organized by David A. Bader, and is co-chaired with Craig A. Lee. The membership list is available here. For more information, please email dbader@eece.unm.edu and lee@aero.org Proposed Charter Related Links On Future Global Grid Communication Performance by C. Lee and J. Stepanek, HCW `01 pfoley@platform.com 46 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 Cluster Performance and the Implications for Distributed, Heterogeneous Grid Performance, by C. Lee, C. DeMatteis, J. Stepanek, and J. Wang, Heterogeneous Computing Workshop: Grid Programming Models Resources Bulk-Synchronous Parallel (BSP) Model elepar Cooperative Data Sharing System (CDS) SIMPLE: A Methodology for Programming High Performance Algorithms on Clusters of Symmetric Multiprocessors (SMPs) Presentations Global Grid Forum 2 (GGF2), Vienna, Virginia, USA, July 16-18, 2001. GGF2 Agenda GGF2 Meeting Notes (010718) Global Grid Forum 1 (GGF1), Amsterdam Science and Tech Center, Netherlands, March 4-7, 2001. GGF1 Agenda GGF1 Meeting Notes (010305) SC00 Grid Forum BOF, SC00, Dallas, TX, Wednesday, 8 November 2000 from 5:30-7:00 PM in room D262-264. Fifth Grid Forum Meeting, Bell-Atlantic Center, Marlborough, MA, October 16-18, 2000. Meeting Notes, October 16 - 18, 2000 Fourth Grid Forum Meeting, Microsoft Corp., Redmond, WA, July 10-12, 2000. Meeting Notes, July 10 - 12, 2000 Third Grid Forum Meeting, University of California, San Diego, CA, March 22-24, 2000. Review Status, March 22, 2000 Summary Report, March 24, 2000 Birds of a Feather at SC99 Presentation, Supercomputing 1999 (SC99), Portland, OR, November 17, 1999. Second Grid Forum Meeting, Northwestern University, Chicago, IL, October 19-21, 1999. Review Status, October 19, 1999 Working Progress, October 20, 1999 Summary Report, October 21, 1999 Birds of a Feather at HPDC-8 Presentation, Eighth IEEE International Symposium on High Performance Distributed Computing, Redondo Beach, CA, August 4, 1999. Working Group Draft Presentation, First Grid Forum Workshop, NASA Ames Research Center, June 17, 1999. pfoley@platform.com 47 New Productivity Initiative WG Architectural Area Grid Forum for Dummies P. Foley Platform Computing May 2002 Working Draft Documents and Outlines Most up to date version of the documents for discussion are: This document will be discussed at the Global Grid Forum 3 (GGF3), Frascati, Italy, October 810, 2001: Grid RPC, Events and Messaging, September 2001, by Craig Lee A Grid Programming Primer, August 2001, has been submitted for review as a Global Grid Forum document. Archive of previous white papers 9.1.6 9.2 History WG Distributed Applications Metadata 9.2.1 People 9.2.2 Contact Data 9.2.3 Charter 9.2.4 Goals and Milestones 9.2.5 Documents/Papers 9.2.6 History 9.3 RG APPS Applications & Testbeds Applications and Testbeds Research Group pfoley@platform.com 48 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 The GGF Applications Research Group seeks to provide a bridge between the wider application community and the developers and directors of grid policies, standards and infrastructures. For more information please visit their website n.b. website (http://www.zib.de/ggf/apps/internal/index.html) is password restricted and not available Ed Seidel: AWG Overview Gabrielle Allen: Applications for the Grid (Cactus Code) Bernard Schutz: Grid Applications in Signal Analysis (AEI) 9.3.1 People 9.3.2 Contact Data 9.3.3 Charter 9.3.4 Goals and Milestones 9.3.5 Documents/Papers 9.4 RG GUS Grid User Services The Grid Forum is an informal consortium of institutions and individuals working on wide-area computing and computational grids. Such technologies underlie the PACI Grid, the Information Power Grid, and other similar efforts worldwide. Eight other Grid Forum working groups are actively addressing other issues in a grid environment. Staff and Particulars In late 1999, joint chairs of the User Services working group were appointed, quickly followed by a volunteer to address web content. One of the group's chairs has had to resign due to a job change. If you are interested in participating in this working group, please follow this link to sign up to receive discussion email and review previous discussions. 9.4.1 People Chair John Towns jtowns@ncsa.uiuc.edu Secretary Jim Ferguson ferguson@ncsa.uiuc.edu pfoley@platform.com 49 New Productivity Initiative WG Architectural Area Grid Forum for Dummies 9.4.2 Contact Data P. Foley Platform Computing May 2002 9.4.3 Charter The User Services Working Group fosters a common understanding of user and support staff requirements in a grid environment, acts as a venue for sharing resources, and facilitates communication for grid activities between users, support staff, and developers. 9.4.4 Goals and Milestones 9.4.5 Documents/Papers Minutes, News and related... These are items of interest: Check the June 2000 intro meeting summary and the slide notes from the GF4 discussion of the best practices working document. Paper and the Presentation entitled "User Support and the Virtual Machine Room" by S.Koranda, B.Loftis, and J.Towns presented in March 2000 at the Cray User Group meeting. Meeting Minutes Meeting Presentations HPCWire November 1999 article on the Grid Forum Other Important Resources Check the NLANR/DAST web pages for information and support for early Grid initiatives. Have a look at the Gridcomputing.com web site for mulitiple links to people around the world with Grid initiatives. Working Draft Documents and Outlines Documents for Discussion at GGF-2 Most up to date version of the documents for discussion are: Grid User Services Best Practices (Lead: John Towns) - Final Draft version in HTML and PDF. Trouble Ticket Interchange (Lead: Hank Laughlin) - Early first draft version in HTML. Infrastructure Requirements for Grid Sites aka the Grid Constitution (Lead: George Myers) - Early first draft version in HTML and PDF. Services and Tools Requirements for Effective Grid Support Services (Lead: Don Frederick) Awaiting first draft. 9.4.6 9.5 9.5.1 History RG GCE Grid Computing Environments People pfoley@platform.com 50 New Productivity Initiative WG Architectural Area Grid Forum for Dummies 9.5.2 Contact Data 9.5.3 Charter 9.5.4 Goals and Milestones 9.5.5 Documents/Papers P. Foley Platform Computing May 2002 9.5.6 History Grid Computing Environments The GGF Grid Computing Environment research group is aimed at contributing to the coherence and interoperability of frameworks, portals, PSE's, and other Grid-based computing environments by establishing standards that are required to integrate technology implementations and solutions. For more information please visit their website. www.computingportals.org The GCE working group is a member of the Global Grid Forum (Global GF), which is a community-initiated forum of individual researchers and practitioners working on distributed computing, or "grid" technologies. Our working group is aimed at contributing to the coherence and interoperability of frameworks, portals, Problem Solving Environments, and other Grid-based computing environments and Grid services. We do this by choosing "best practices" projects to derive standards, protocols, API's and SDK's that are required to integrate technology implementations and solutions. Please refer to our charter for more details, and subscribe to our mailing list if you wish to participate. This website is hosted by, and has evolved from the ComputingPortals.org and DATORR (Desktop Access to Remote Resources) organizations), both of which are spin-offs from Java Grande Forum efforts. As with these organizations, GCE is a collaborative effort between different Computer Science projects to enable desktop to remote resources including, supercomputers, network of workstations, smart instruments, data resources, and more. This site has been mainained by Mississippi State University since the first day of the XXIst century. 9.5.7 People Co-chair Geoffrey Fox fox@mailer.scri.fsu.edu Co-chair Dennis Gannon gannon@cs.indiana.edu Co-chair Mary Thomas mthomas@sdsc.edu Secretary Jason Novotny DNovotny@lbl.gov pfoley@platform.com 51 New Productivity Initiative WG Architectural Area Grid Forum for Dummies 9.5.8 Contact Data P. Foley Platform Computing May 2002 9.5.9 Charter The Grid Computing Environment working group is aimed at contributing to the coherence and interoperability of frameworks, portals, PSE's, and other Grid-based computing environments and Grid services. We will do this by deriving standards, protocols, API's and SDK's from "best practices" projects that are required to integrate technology implementations and solutions. Definition of a Grid Computing Envrionment: A GCE extends the users desktop by providing tools that access the Grid services. Examples: Portals: users, education - web, other CACTUS, UNICORE, HotPage, LaunchPad, Mississippi Web Portal Workflow: systems to help manage large tasks involving multiple steps Applications - Cactus Collaborative Envs: WebDav, (a subset?) Object frameworks: application composition tools How do we consider: Shell/env, NES: Network enable service (Ninf, Netsolve) Description of the Grid Computing Environments Working Group One of the primary functions of this WG will be to collect information on GCE's, and synthesize the data into a set of relevant categories and subcategories of CGE activities. We then plan to use this information to define what GCE's are and what they do, how they accomplish their tasks, what technologies are used to do this, and what the resultant Grid services are needed to do these tasks, and how well are these projects able to use the existing Grid services and technologies. We see the role of CGE with respect to the other WGs as shown below (this in not to imply that they do not have their own relationships): Portals/Apps/Users Grid Services |<--> GIS-WG Models-WG <-->| |<--> Accts-WG Apps-WG <-->| <--> GCE-WG <--> |<--> Performance-WG Users-WG <-->| |<--> Data-WG GCE-WG <-->| |<--> Scheduling-WG |<--> Security-WG Our function is to identify how developers are using the Grid and it's services, and by using a task-oriented approach to extract out functionality, API's, and protocols and to facilitate interoperability between users of the Grid and developers of the Grid based on what can be done today and what can/should be done in with next generation of software. Our information will have a bi-directional flow between service working groups and those that sit at "higher" levels of the 3tier Grid architecture. Goals and milestones pfoley@platform.com 52 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 9.5.10 Goals and Milestones The GCE working group will initially focus on generating TS documents to provide API and protocol recommendations for the GCE group and other working groups. We will limit these to existing working projects. These API's and protocols will be built using the following process: Identify "Best Practices" projects such as User portals Application Area portals and PSEs: CACTUS Grid Application workflow management Others. Identify Tasks and "Atomic Tasks" User views to Grid services Abstract tasks for each GCE Identify if task matches to a working group Not all tasks will have a WG, nor will it need them For each task, identify items such as: Associate with current WG's where possible Common/standard grid services, APIs, SDKs and Protocols, technologies Grid/Industry standard interop Architecture(s) for GCE framework(s). language independent common technologies used Note: API's can hide/encapsulate component architecture Collect Software Toolkits for building Grid applications such as Java and Perl CoG's MyProxy, GSI GridPort and GPDK Identify leads to champion each of these CP summaries - we won't start one unless we have a lead to do it. Publish information into NLANR C/Klearinghouse http://dast.nlanr.net/Clearinghouse Generate TR's Recommendations for GF documents: 9.5.11 Documents/Papers Foster et al. Building the Grid: An Integrated Sevices and Toolkit Architecture for Next Generation Networked Applications (DRAFT) M. Baker R. Buyya D. Laforenza The Grid: International Efforts in Global Computing abstract pfoley@platform.com 53 New Productivity Initiative WG Architectural Area Grid Forum for Dummies R. Buyya P. Foley Platform Computing May 2002 D. Abramson J. Giddy An Economy Driven Resource Management Architecture for Global Computational Power Grids C. A. Lee A Grid Programming Approach T. M. Eidson Grid Programing Environments: A Component-compatible Approach A. Gilman Universal Design and The Grid G. C. Fox Portals for Web Based Education and Computational Science D. Gannon et al. Indiana Portal Effort T. Haupt P. Bangalore G. Henley A Computational Web Portal for the Distributed Marine Environment Forecast System M. Thomas S. Mock J. Boisseau Development of Web Toolkits for Computational Science Portals 9.5.12 History 9.6 RG APM Advanced Programming Models 9.6.1 People 9.6.2 Contact Data 9.6.3 Charter 9.6.4 Goals and Milestones 9.6.5 Documents/Papers 9.6.6 History 9.7 9.7.1 RG ACE Advanced Collaborative Environments People pfoley@platform.com 54 New Productivity Initiative WG Architectural Area Grid Forum for Dummies Jason Leigh P. Foley Platform Computing May 2002 9.7.2 Contact Data Working Group Mailing List : ace-grid@gridforum.org To subscribe to the working group list, send email to majordomo@gridforum.org with "subscribe ace-grid" as a single line in the message body. Do not include the quotation marks. You must be a member of an email list to post to it. Grid Forum Mailing List : grid-announce@gridforum.org If you subscribe to the working group list please be sure to also subscribe to the general list. To do this, send email to majordomo@gridforum.org with "subscribe grid-announce" as a single line in the message body. 9.7.3 Charter 9.7.4 Goals and Milestones 9.7.5 Documents/Papers Advanced Collaborative Environments The Advanced Collaborative Environments (ACE) Grid Working Group complements other Grid Working Groups by providing human-centered techniques and technologies for facilitating interactive, collaborative, and immersive access of Grid resources from any where and at any time. For more information please visit their website. Area News & Updates: What's Next? The User Services Working Group fosters a common understanding of user and support staff requirements in a grid environment, acts as a venue for sharing resources, and facilitates communication for grid activities between users, support staff, and developers. Second Workshop on Advanced Collaborative Environments 2nd IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2002) Berlin, 21-24 May 2002 pfoley@platform.com 55 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 http://www-fp.mcs.anl.gov/fl/wace/summer2002/index-wace2002.htm conference in Washington DC. Click here for CALL FOR ABSTRACTS Mailing Lists Minutes, News and related... Tools and Software Taxonomy of Collaboration, Visualization and VR Tools Listing of existing tools that participants are interested in integrating with the Grids environment and tools under development for the Grid environment. The list: Provides a means for users outside of your community to become aware of the systems and expertise within the ACE Grid group. Provides a means to identify systems with common capabilities, services or grid service needs. We expect to use the needs to determine what other Grid Forum working groups we need to be working with. The common capabilities and services identify potential standards efforts. Identifies experts who can aid in the design of ACE systems and standards (e.g. experts in human factors, designers of systems, Grids middleware experts, etc.) CAVERNsoft Jason Leigh cavern@evl.uic.edu Links Tele-Immersion at the Electronic Visualization Laboratory CAVERNsoft CAVERNUS The Advanced CAVERNUS Workshop Series AccessGrid AGAVE 9.7.6 10 History Area to be determined 10.1 RG GHPNRG Grid High-Performance Networking Research Group 10.1.1 People Co-chair Jon Crowcroft Jon.Crowcroft@cl.cam.ac.uk Co-chari lowekamp@cs.wm.edu Bruce Lowekamp pfoley@platform.com 56 New Productivity Initiative WG Architectural Area Grid Forum for Dummies Secretary Nagi Rao raons@ornl.gov Secretary V.Sander@fz-juelich.de Volker Sander P. Foley Platform Computing May 2002 10.1.2 Contact Data Mailing List: <ghpn-wg@gridforum.org> is used for RG communication. It will probably be renamed in the near future. Subscription Request: send an email to <majordomo@gridforum.org> with the body "subscribe ghpn-wg" Home page: http://www.csm.ornl.gov/ghpn/GHPNHome.html Email archive: http://www-unix.gridforum.org/mail_archive/ghpn-wg/maillist.html 10.1.3 Charter The Grid High-Performance Networking Research Group focuses on the relationship between network research and Grid application and infrastructure development. The objective of GHPNRG is to bridge the gap between the networking and grid research communities. It accomplishes its goal by serving as a forum for information exchange on advances and requirements in both fields, as well as by providing a focal point for liaison activities between the GGF and the various networking standards bodies. Specific topics of interest include, but are not limited to: End-to-end performance High-performance transport protocols Emerging network technologies The interface between Grid applications and network services Deployment of new technologies on the Internet and overlay networks The GHPNRG provides a forum for such topics until sufficient maturity and interest to both communities is reached that naturally results in the formation of a separate WG or RG to pursue them further. The discussions of GHPN are carried out both during the meetings and on the GHPN mailing list. Two specific goals of the GHPNRG are identifying: grid application requirements and implementations that are not supported or understood by the networking community and advanced networking features that are not being utilized by grid applications. The natural forum for communicating the results of its work are through the periodic release of informational documents. The initial documents will concentrate on identifying gaps in understanding between the grid and networking communities. As GHPNRG identifies and explores topics, further informational documents will be written and released to the community. 10.1.4 Goals and Milestones July 2002 Begin work on both top-ten documents. October 2002 First complete drafts of top-ten documents. Begin circulation with other groups. February 2003 Combine feedback from other groups, submit top-ten documents for GWD-I track. Ongoing Are net100 and related work having appropriate affect in the grid community? Ongoing What high-performance transport protocols are needed for grid applications? pfoley@platform.com 57 New Productivity Initiative WG P. Foley Architectural Area Platform Computing Grid Forum for Dummies May 2002 Ongoing What demands do grid applications put on the network. Is this being addressed by networking research? Do some grid applications abuse the network? The ongoing goals are important topics that the GHPNRG is concentrating its energy on. Meetings will be held on specific topics when sufficient results have been produced to warrant a constructive session. The results of this work will determine whether such topics need to be continued within GHPNRG, referred to another body, form a new GGF group, or result in a GHPNRG informational document 10.1.5 Documents/Papers Top ten things grid programmers wish network engineers knew Top ten things network engineers wish grid programmers knew 10.1.6 History Charter approved 26 April 2002 BOF at GGF-5, Toronto 10.2 WG Cluster Standardizations – Proposed 10.2.1 People 10.2.2 Contact Data 10.2.3 Charter 10.2.4 Goals and Milestones 10.2.5 Documents/Papers 10.2.6 History 10.3 Discovery and Monitoring Event Description WG Proposed 27 Feb 2002 Proposed Title: Discovery And Monitoring Event Description Working Group Proposed Chairs: Jennifer Schopf, ANL, and James Magowan, IBM Proposed Web-tsar: Dan Gunter Mailing list: damed-wg@gridforum.org (to subscribe, send an email with the subject (minus quotes) "subscribe damed-wg" to majordomo@gridforum.org) pfoley@platform.com 58 New Productivity Initiative WG Architectural Area Grid Forum for Dummies Web page: http://www-didc.lbl.gov/damed/ P. Foley Platform Computing May 2002 We propose a working group to define a basic set of monitoring event descriptions. These descriptions, or schemas, will describe the information (attributes) associated with a particular data element and will describe conventions for the representation of the value associated with it. The development of this sort of shared vocabulary is essential for interoperability among a growing number of testbeds and projects. This view is supported by the recent proliferation of independent efforts along these lines, both inside and outside the GGF. The aim of this group is to develop standard representations of the most widely used measurement values (the "top N".) From this we envision the emergence of a set of conventions and recommendations that will ease the task of defining richer, domain-specific schemas. Milestones include: 1) Research existing schemas, draft of comparison of some schemas - Completion by April 2002 (currently in progress) 2) Develop "English" descriptions for the "top N" monitoring elements. This will not cover all future event schema needs, but will rather approach the intuitive subset that is in wide use today. - Completion by May 2002 3) Map English definitions to basic technologies including LDAP, SQL, XML. - Draft for discussion by GGF-5 4) Evaluate use of data models (for example relational, hierarchical, etc.) - Draft for discussion by GGF-5 5) Evaluate various data models in light of discovery of available monitoring data. Assuming a distributed infrastructure, mechanisms for discovery of events are non-trivial and various techniques in use will be compared. - Draft for discussion by fall 2002 6) Evaluate use of schema languages (e.g., GOS / XMLSchema / RDF / CIM) - Draft for discussion by fall 2002 The list of interested parties who have volunteered their time (to date) includes: Dan Gunter, LBNL Bruce Lowekamp, College of William and Mary James Magowan, IBM, UK Manfred Oevers, IBM, UK Jennifer Schopf, ANL Warren Smith, NASA Martin Swany, UCSB Brian Tierney, LBNL pfoley@platform.com 59