Meeting Goals
review achievements
review architecture
identify targets for AG2 and VOTECH



14-Dec-2004
gaps
technology changes
components for re-engineering
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
1
Tuesday
AM : overviews / guest talks
LUNCH 1230-1330
PM : Demos / Tech detail / planning
DINNER : Beluga, Chambers St 1930
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
2
Dinner
NeSC
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
3
Wednesday
0930 start
Architecture review and analysis
1530 finish
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
4
State of the Union
AstroGrid scorecard
The global VO
AstroGrid today
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
6
AstroGrid scorecard
achievements since april meeting
Integration
Deployment
Architecture
VOTECH funded

14-Dec-2004
kick-off meeting November
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
8
AstroGrid timeline
Apr 01
14-Dec-2004
Proposal to PPARC
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
9
words from april 2001 proposal
(3.1) LONG TERM PERSPECTIVE
The vision of a "Virtual Observatory" only makes eventual sense as a global entity
(GVO ?)..... It is our impression that such aspirations will only become reality on a
timescale of perhaps 6 years or so, but that the components and toolkits will start
to develop much sooner. Likewise, the underlying computer science will on the one
hand evolve as we try to apply it, and on the other hand will be looking for
challenging applications to influence its evolution.
In this perspective we believe that a major but short-term (three year) project is the
correct first step, as after this we must take stock and re-group. The UK cannot
build the GVO by itself, but we should not wait either. Our overall aims are therefore
(i) to provide a working system for UK astronomers to exploit key databases,
(ii) to develop tools and methods that the international community will see
as key contributions to an eventual GVO, and
(iii) to learn technical lessons as fast as possible that will influence
the design of an eventual GVO.
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
10
AstroGrid timeline
Apr 01
14-Dec-2004
Proposal to PPARC
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
11
AstroGrid timeline
Apr 01
Proposal to PPARC
Oct 01 - Dec 02
Phase A study
Jan 03 - Dec 04
Phase B construction
------------------------------------------------Jan 05 - Dec 07
AstroGrid2
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
12
AstroGrid timeline
Oct 01 - Dec 02

Technology assessment
Jan 03 - Dec 04





14-Dec-2004
Phase B construction
Infrastructure components
First deployment
Jan 05 - Dec 06

Phase A study
: s/w beta release
: beta tester release
AstroGrid2
re-engineering
more compts
multiple deployments
next wave R&D (VOTECH)
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
13
Promises to PPARC :
Phase B goals

14-Dec-2004
the eightfold path ...
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
14
goal check (1-4)
develop standards for data, metadata, data exchange and provenance
done with IVOA
develop a software infrastructure for data services
done but still growing
establish a physical grid of resources
done with DC help; modest start
construct and maintain a Service and Resource Registry
done
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
15
goal check (5-8)
implement a working VO system of real scientific use to astronomers
half done; beta test stage
provide a user interface to that VO system
technical components : done
user friendly skin : half done
provide or adapt a set of science user tools to work with the VO
provide : officially abandoned due to lack of resource
adapt : done
establish a leading position for the UK in VO work
done
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
16
the global VO
the global VO
key AstroGrid contributions
publishing metaphor
experiments/facilities are authors
data centres are publishers
VO portals are shops
end-users are readers
VO infrastructure is distribution system.
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
19
work to do
agree standards
build VO-aware data services
build VO-aware tools
build software glue
construct deployments, get users
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
20
progress
agree standards

excellent progress through IVOA
build VO-aware data services
build VO-aware tools
build software glue
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
21
International VO alliance (IVOA)
http://www.ivoa.net
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
22
progress
agree standards

excellent progress through IVOA
build VO-aware data services

data centres upgrading worldwide
build VO-aware tools

a few examples : CEA should allow to take off
build software glue


14-Dec-2004
Registry, Workflow, VOspace...
sign-on to come
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
23
deployments and users
several hand crafted-demos

some real science done
US-NVO has some simple production websites

OpenSkyQuery / DataScope / YourSky
AstroGrid portal will allow more complex jobs
first users starting to play


14-Dec-2004
AVO SWG; AstroGrid AGSAG
NVO summer school
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
24
does it look like a VO yet ?
data interoperability
resource interoperability
data integration
single sign on
complex jobs
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
25
does it look like a VO yet ?
data interoperability




14-Dec-2004
good progress
data access : VOtable, SIAP, SSAP
semantic dictionary : UCDs
will need refreshing
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
26
does it look like a VO yet ?
resource interoperability






14-Dec-2004
good progress
Resource and Service Metadata
harvestable registries
standard query language ADQL
progress on WS interfaces
storage sharing (MySpace)
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
27
does it look like a VO yet ?
data integration



not really there; only plain cone-searches
really science / algorithm problem not IT
need real semantics - not just types


14-Dec-2004
UCNs; units; grammar
concentrate on operations not philosophy
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
28
catalogue xmatch is the easy bit ...
federating
these is a bit
more subtle
Shocks seen in the Xray
Heavy elements
seen in the
Dust seen in the IR
Relativistic electrons
seen in the radio
as is these...
Coronal mass ejection
imaged by spacebased solar
observatory
Effect detected hours later
by
satellites and ground radar
does it look like a VO yet ?
data integration



not really there; only plain cone-searches
really science / algorithm problem not IT
need real semantics - not just types


14-Dec-2004
UCNs; units; grammar
concentrate on operations not philosophy
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
32
does it look like a VO yet ?
single sign on




14-Dec-2004
limited IVOA attention (GWS-WG)
AstroGrid shell in place
need to cohere with rest of academia
Shibboleth looks like the winner ?
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
33
does it look like a VO yet ?
complex jobs : workflow



14-Dec-2004
negligible IVOA attention
AstroGrid : workflow engine and UI
AstroGrid : application integration
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
34
AstroGrid today
AstroGrid strands
Standards development
R&D
Infrastructure software product
Deployment
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
36
Customers
Standards : other VO projects
R&D : ourselves, other VO projects
Software : DCs, VO projects, tools writers
Deployment : astronomical community
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
37
Software product aims
product quality
mix-and-match
plug-and-play
publisher help (PAL and CEA)
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
38
Secret Weapons
MySpace
Workflow
Application integration : CEA
14-Dec-2004
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
39
Deployment today
Registry, Workflow, MySpace, Portal
Distributed data, storage, and services

Leicester, Geneva, MSSL, Edinburgh,
Cambridge, ESO
Querying, xmatching, cpu-intensive analysis
VO-aware applications

14-Dec-2004
e.g. Sextractor, HyperZ, moviemaker
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
40
Issues
Stability
Useability
Missing components

IAA, scripting, workbench, grid services
Improved functionality



14-Dec-2004
intelligent resource discovery
ambitious data mining services
using GridPower
Andy Lawrence : AstroGrid Consortium Meeting, Edinburgh
41
FIN