ANNEX I - DESCRIPTION OF WORK
1.
TITLE
Astrophysical Virtual Observatory
Short Title: AVO
List of participants:
1. European Southern Observatory (ESO) established in Germany
2. Space Telescope – European Coordinating Facility (ST-ECF) established in Germany
3. The University of Edinburgh (UEDIN-Astrogrid) established in Scotland
4. “Unité Mixte de Recherche” composed of:
a) Centre National de la Recherche Scientifique – Delegation Alsace (CNRS DelA )
established in France
b) Université Louis Pasteur (ULP) established in France
(a) and (b) above come under the Centre de Données astronomiques de Strasbourg (CDS)
5. Centre National de la Recherche Scientifique – Delegation Paris A (CNRS DR01-Terapix)
established in France
6. The Victoria University of Manchester (UMAN-Jodrell Bank) established in England.
2.
OBJECTIVES
2.1 Scientific Objectives
The Astrophysical Virtual Observatory (AVO) project will support a number of work packages
that constitute a Phase A study. The three year Phase A work program will lay all the necessary
groundwork for a Phase B implementation of a fully operational virtual observatory facility for
Europe. The Phase A program will have the following key objectives:








To develop a detailed set of scientific requirements for the design, implementation and
operation of an AVO following the GRID paradigm of distributed and scalable
computational infrastructures
To define appropriate standards and interfaces for the federation of astronomical data
archives from space and ground facilities into a coherent data warehouse for the AVO
To conduct a demonstration and feasibility program for archive interoperability by
deploying emerging technology to a small number of currently operational, non-federated,
archive centres from the proposal participants to form a multi-wavelength research resource
To assess, develop and deploy new scalable solutions for AVO storage and computational
needs following, and in coordination with, GRID initiatives in other disciplines
To assess, develop and deploy test systems for the astronomical utilization of GRID
technologies in the area of remote resource utilization
To facilitate the interaction and collaborative work of experts (astronomers, software and
hardware engineers) to assess and deploy GRID technologies for European astronomy
To initiate dialogue and research relationships with European industry in key AVO and
GRID technology areas such as networking, database design and storage management
To build collaborative links to similar efforts in the US, Canada and Australia with a view
to the expansion of the virtual observatory facility on a global scale.
2.2 Methodology
The project will adopt the following methodology to achieve the above mentioned objectives :
1

Science Requirements and Case for the AVO
o Conduct a review of the scientific quality of the existing Archives
and draft of the scientific requirements for the standard AVO
quality control procedures
o Gather scientific requirements extracted by careful analysis of the
current and future ASTROVIRTEL programmes
o Form AVO Science Advisory Working Group
o Issue specific AVO Calls for Proposals (in close coordination with
ASTROVIRTEL) in order to stimulate new scientific approaches
and to feed their requirements into the AVO design.
o A Phase B plan will be constructed that addresses the following
issues:
 Conceptual systems design
 Science Operations and Operations Implementation Plan
 Full science case, requirements and use cases
 Project management plan and budget projections
 Statement of work, work breakdown structure and program
milestones
 International coordination and involvement
 Coordination with, and utilization of, GRID network facilities
and infrastructure
 Requirements on the European research network infrastructure
and international connections.

GRID Technologies for Astronomy
o Form coordination and development relationships with GRID programs in Europe and the US.
o Identification of key AVO GRID component systems and technologies for astronomy
o Assessment of these components via prototyping and test-bed programs.

Interoperability Testbed
o Assessment of current archive status at all participant sites with respect to holdings and
software interfaces and selection of demonstration sites
o Identification of key datasets for interoperability demonstration projects
o Formulation of systems and software integration requirements
o Deployment of interoperability components to archive sites
o Definition and test implementation of some new functionalities issued from prototype
evaluation and AVO trial use cases resulting from the calls for proposals
o Interoperability demonstration program.

Scalable Computation and Storage Technologies
o Development of Beowulf clusters software for AVO applications and deployment to Phase A
participants for test and assessment
o Development and deployment of new storage system hardware and software for operational
needs within the ESO/ST-ECF archive in support of AVO Phase A test programs
o Deployment of scalable storage systems to Phase A participant sites for Phase A test
program support.
2
3.
ROLE OF PARTICIPANTS
The AVO Phase A work program will involve all participants in the following principal areas
of responsibility:
ESO :
ST-ECF :
UEDIN-Astrogrid:
CDS:
CNRS DR01-Terapix:
UMAN-Jodrell Bank:
Program Management + AVO technologies
Science Case and Requirements
AVO technologies
Interoperability testbed
AVO technologies + Science Case
AVO technologies + Science Case
Each member will have involvement in all levels of the Phase A program as detailed in the
Work Plan via distributed work packages.
4.
DELIVERABLES AND WORK PLANNING/SCHEDULE
4.1 Work Planning
The project will be divided into the following primary work packages:
Work Package 0: Program Management
WP
WP Name
Description
Actions
Deliverables &
Milestones
0.1
Program
Management
Continuous
0.2
Phase B Plan
Overall programme
management and
reporting
Definition of the
requirements for
the implementation
of the AVO in the
operational phase.
- annual reports
and mid-term
report
- Phase B
comprehensive
plan
[+ 33 months]
- Conceptual systems
design
- Science Operations
and Operations
Implementation Plan
- Project management
plan and budget
projections
- Statement of work,
work breakdown
structure and program
milestones
Human
Resources
(person
months)
30
6
TOTAL : 36
3
Work Package 1: Science
WP
WP Name
Description
1.1
Definition of
AVO Science
Reference
Mission
Defining the
science goals
against which
the AVO
scientific impact
can be measured
1.2
1.3
Actions
- Appointment of
Science Working
Group
- Critical analysis
of ASTROVIRTEL
proposals
- Preparation and
issue of AVO Call
for Proposal
Definition of Defining the
- Definition data
the AVO
scientific
types
Scientific
requirements for - Definition of
requirements the
Quality Assessment
implementation criteria
of the AVO
- Test definitions
- Definition of
Science
requirements on
algorithms and
procedures
Pilot
Pilot
- Selection of test
implementati implementation cases
on of selected of selected AVO Design
and
science cases science projects. implementation of
required algorithms
and procedures.
- Running the
procedures and
implement feedback
- Critical
discussion of
results
Deliverables &
Milestones
Human
Resources
(person
months)
46
Document (AVO
Science Reference
Mission)
[+12 months]
Documents, Test report
[+24 months]
46
Software packages,
documents, test reports
[+33 months]
47
TOTAL : 139
4
Work Package 2: Interoperability
WP
WP Name
Description
2.1
Inclusion of
archives in
the interoperability
system
All catalogue data
will be included
in VizieR and in
Aladin (if
suitable).
2.2
2.3
2.4
Actions
Target archives and
surveys are the
following: VLT,
NTT, EIS (ESO);
HST/ECF, ISO,
XMM (ST-ECF);
Wide Field UK
archives; UMANJodrell Bank;
CNRS-DR01Terapix reduced
pixels
Running of Pilot
Running of science
tests and
implementation of cases proposed by
evaluation
selected AVO
project teams or
of results
science projects.
through
AVO
proposal.
- Evaluation of
results.
- Opening of the
interoperability
system for
community usage.
Implementa Definition,
- Development of
tion of new development and an information
functionalit- implementation of discovery tool. This
ies
new
will require the
functionalities in
definition of
the
metadata
interoperability
describing the
system.
dataset contents, in
collaboration with
the archive
providers.
- Implementation
of crossidentification
functions (first
studied in the frame
of the ESO/CDS
data mining
project).
- Other
developments can
arise from 1.3, 2.2.
Evaluation
VizieR/Aladin vs - Working group
of inter other tools
activity
operability
available or
tool
developed in the
frame of other
VO initiatives.
Deliverables &
Milestones
working prototype of
interoperable European
archives, through
VizieR and Aladin.
[+12 months]
The tests will produce
scientific results;
evaluation of the inter operability system;
identification of new
desirable
functionalities.
[+24 months]
Human
Resources
(person
months)
24
76
Improvements to the
114
federation and
integration tools;
Assessment of
difficulties encountered,
evaluation of methods,
...
[+33 months]
- Report
[+33 months]
6
TOTAL : 220
5
Work Package 3: Technology
WP
WP Name
Description
Actions
Deliverables &
Milestones
Human
Resources
(person
months)
Network 59
3.1
Grid
Technology
Technological
choices need to
be tested,
assessed, and
developed in the
context of the
AVO, and the
necessary skill
sets developed
and shared
- establish working
data grid across lab
- establish working
data grid across
participant
organisations
- design benchmark
tasks for measuring
grid performance
- measure real
delivered
bandwidths
- determine network
bottlenecks
- test middleware
choices
-Benchmark
Tasks
[+12 months]
- Middleware assessment
report
and
recommendations
[+ 24 months]
- Network analysis report
and recommendation on
strategic network
investments.
[+24 months]
- Demonstration of
working datagrid
[+24 months]
3.2
Storage/
Computer
Technology
The participants
need to assess
rival choices to
make an
implementation
choice for Phase
B
- establish liaison
with key suppliers
- purchase or borrow
storage and
computer options for
test
- test storage choices
- run on main
architecture
choices.
3.3
Database
Technology
Benchmark Network
59
Tasks.
[+12 months]
Storage assessment
report and
recommendations
[+24 months]
Architecture assessment
report
and
recommendations
[+30 months]
Assess technical - establish supplier - Benchmark datamining 60
and commercial
and developer tasks
options for AVO
liaison
[+12 months]
DB needs
- design benchmarks - DBMS assessment
- run main DBMS
report and
choices
recommendations
- establish working
[+ 18months]
beta test system
- Working datamining
system for external
user testing
[+24 months]
TOTAL : 178
6
4.2 Allocation of Human Resources between participants
The allocation of human resources is shown in the table below.
Participant
Person Months funded
by the project
1. ESO
57.60
2. ST-ECF
34.35
3. UEDIN-Astrogrid
72.00
4. CDS
54.00
5. CNRS DR01
32.35
6. UMAN-Jodrell Bank
36.00
Total
286.3
Person months not
funded by the project
57.60
34.35
72.0
54.00
32.35
36.0
Total Person
Months
115.2
68.7
144.0
108.0
64.7
72.0
286.3
572.6
4.3. Durable Equipment
The equipment that is necessary for the project is shown in the table below.
Participant
1. ESO
2. ST-ECF
3. UEDIN-Astrogrid
5. CNRS DR01Terapix
6. UMAN-Jodrell
Bank
Description
New Generation Archive
System Technologies
(NGAST) # 1, # 2, # 3
Workstations, data
warehouse server and
database system
Personal Computers
Workstations and servers
Purchased/Provided
44% funded by the EU
Work Package
2 and 3
51% funded by the EU
1, 2 and 3
100% funded by the EU
100% funded by the EU
2 and 3
2 and 3
Workstations and servers
100% funded by the EU
2 and 3
4.4 Other Specific Costs
Under Work Package 3 (Technology) certain investigations of database and associated
technologies will require the licensing of commercial database and software products. Approval is
hereby given for these licence costs to be incurred to the contract.
4.5 Management Structure
The overall AVO organization for Phase-A consists of the AVO Executive Committee
(AVOEC) and the AVO Programme Office (AVOPO). The AVOEC consists of the AVO
project coordinators from each of the six member organizations. The AVOEC is responsible
for the interfacing of AVO activities to the European and international community. The
AVOPO is responsible for the management of all AVO work packages in the four main
work areas and the final preparation and submission of the AVO Phase-B proposal.
7
The total work programme will be under the responsibility of an AVO Programme Manager.
The programme manager will utilize a programme coordinator/systems engineer to oversee
all work package activities and report on the global status and activity in the AVO
programme. The work will be divided into four main work packages each under the
responsibility of a work package manager. The overall work breakdown structure is
presented in Figure 1.
Work Package 0
AVO Programme Management
WA Manager/Programme Manager
ESO
WP0.1
Programme Management
AVO Program Coordinator
Systems Engineer
WP 0.2
Phase B Plan
WP Manager
Work Package 1
Science
WA Manager
ST-ECF
Work Package 2
Interoperability
WA Manage
CDS
Work Package 3
Technology
WA Manager
UEDIN-ASTROGRID
WP 1.1
AVO SRM
WP Manager
WP 2.1
Archives Inclusion
WP Manager
WP 3.1
GRID Technology
WP Manager
WP 1.2
AVO Sci. Requirements
WP Manager
WP 2.2
Test and Evaluation
WP Manager
WP 3.2
Store/Compute Tech.
WP Manager
WP 1.3
Implement Sci. Cases
WP Manager
WP 2.3
New Functionality
WP Manager
WP 3.3
Database Tech.
WP Manager
WP 2.4
Tool Evaluation
WP Manager
Figure 1: AVO Management Structure
4.6. Exploitation of results
The current project is a Phase A work program for an integrated virtual
observatory for Europe. The results of Phase A will be of three kinds.
Firstly a detailed set of science requirements, secondly a prototype
implementation of interoperability interfaces and thirdly an assessment and
test bed analysis of critical GRID technologies for the virtual observatory.
These results will be exploited to construct a complete Phase B plan for the
operations of the virtual observatory covering production software
developments, network infrastructure, operations staffing and
8
compute/storage hardware resources. The results will be communicated to
the OPTICON community and exploited in collaboration with international
affiliates to work towards a global virtual observatory in operations by
2006. The results of the Phase A program will be further exploited to form
development relationships with European industrial partners in the Phase B
proposal.
5.
COMPLEMENTARY PROJECTS
The AVO Project is complementary to the following EU funded projects: ASTROWISE and
OPTICON.
The OPTICON thematic network (Optical Infrared Coordination Network for Astronomy –
Contract Number HPRI-CT-1999-40003) aims to create collaborations for coherent and
prioritised programs across the European astronomical community.
The Project ASTROWISE, if financed, (Proposal Number HPRI-2001-500057) will develop
astronomical digital survey building capabilities which will be shared among members of the
European astronomical community. These new resources of hardware and software will be able
to process the data flow from large, wide field digital cameras like OMEGACAM on the VLT
Survey Telescope (http://www.astro.rug.nl/~omegacam). ASTROWISE is a content builder for
the AVO which will allow the sharing of the data flow products to the community via the
virtual observatory.
9