As an eSI Visiting
Researcher
Beth Plale
Computer Science Dept.
Indiana University
Background
• Involved in GGF since early ‘GF’ days
• Relational Grid Information System
research group (RGIS-RG) chair
(inception-Jan 2003)
• Systems researcher
– distributed systems, and
– experimental evaluation
• Main research thread is data streams
Attraction of eSI
• UK respected in grid community for expertise
in databases
– My research crosses systems and databases
• Opportunity to work with OGSA-DAI PIs,
OGSA-DAI development team, and GGF
DAIS WG leaders
• Took opportunity to develop scheme for
handling stream queries within DAIS
framework
Stream systems span range of
functionality
size
Data manipulation
and
systems
overlap
number -processing large
of
amounts of data
stream
chunks
analyzed
Stream monitoring
systems
-identifying unusual
behavior
Stream routing
systems
- event delivery
timeliness demands
on response
Stream systems: events arrive and
queries long standing (not vice versa)
queries added
through user
interface
long-standing
queries
Results multicast to owners
of satisfied queries
stock quote stream
Each arriving
event matched
against set of
queries
DAIS model applied to traditional
database
queries pushed into
external data source
Data
Source
(e.g., RDBMS)
OGSADAI
Data
Service
Rowset
Rowset
Rowset
Data
Data
Data
Service
Service
Service
Instance
Instance
Instance
request
transport
mechanism
(could be
pub/sub
system)
response
DAIS model applied to data stream
source
Queries pushed into
external data resource
distributed,
virtual data
source
Long
running
queries
OGSADAI
Data
Service
Rowset
Data
Service
streamed
response
http://lead.ou.edu
LEAD Data Cloud
Data stream architecture: DAIS and
dQUOB
dQUOB
queries
Rich query
operator
support in
external
resources
dQUOB
queries
dQUOB
SQL
compiler
subquery
scripts
query
request
Data
Service
dQUOB
queries
stream
Result
stream
stream
Rowset
Data
Service
WRF
WRF
WRF
weather
model
model
forecasting
model
Positive Outcomes
• Relationships (!)
• Increased understanding on both sides
• Scheme for how to handle stream
queries in DAIS framework
• LEAD project leverages OGSA-DAI
Ongoing and Future
Collaboration
• Instrumentation of OGSA-DAI
– RGRbench
• Leverage OGSA-DAI in LEAD
– Provide feedback on our experiences
• Use
• development
• Future visits (both directions)
• International funding barrier?
Beth Plale
plale@cs.indiana.edu
http://www.cs.indiana.edu/~plale