A Profile on the Grid Data Engine
(GridDaEn)
Xiao Nong
Email: xiao-n@vip.sina.com
www.griddaen.org
www.datagrid.com.cn
School of Computer, National University of Defense Technology
1
GridDaEn Focus
 Integration

Integrate heterogeneous mass storage resources
located in multiple domains
 Effective

and secure data operations
Access, storage, dispatch, replication, and
movement
 Transparent
Federated services
Name transparence
 Location transparence
 Protocol transparence
 Uniform access

School of Computer, National University of Defense Technology
2
Overview
GridDaEn
Data Center 1
NFS
Deployment
and
Management
CINF
Oracle
Environment
Data Center 2
Data Center n
NFS
Integrated Access
and Processing
FTP
Data
XML
NFS
School of Computer, National University of Defense Technology
3
GridDaEn Architecture

Access interface layer：


Application(GridDaen
Client )
MDIS(metadata
Information
Server)
System service layer：






Data service interfaces for
grid users
Metadata service
Data service
Monitor service
Security service
…
Data operation layer：

DRB(Data Request
Broker)
NFS
CINF
NFS
UNIX
Access interfaces to fabric
storage
School of Computer, National University of Defense Technology
4
GridDaEn Architecture
Client
Uniform Operating Interface & Global Management
5
School of Computer, National University of Defense Technology
System Monitor
Configuration
Management
User Management
Audit
User Mapping
Authentication
&Authorization
Replica Management
&Selection
Registry & Publish
System Metadata
Access &Management
Data Metadata Access
&Management
Data Replication
&Caching
Data Transfer&
manipulation
Remote Accessing
Request Dispatch
Resource Description
&publish
Co-Scheduling
Resource
Infor Service
DB2
UNIX, NT
Oracle,Sybase
Database
Access
Interface
File System
Access Interface
Metadata
Access
Interface
Resource
Access Interface
System
Management
Security
Metadata Service
Data Service
Resource
Aggregator
GridDaEn Components





DRB:Data Request Broker
MDIS:MetaData Information Server
GridDaEnSI:Security Infrastructure
GridEye:Monitor System
GridDaEnSM: System Management
School of Computer, National University of Defense Technology
6
Distributed Data Access and
Management
Client
High-level MDIS
MDIS
Optimization and
Scheduling
Data Service
Data Service
Local MDIS
DRB
Data Center A
Data Service
Local MDIS
DRB
Data Center B
Local MDIS
DRB
Data Center C
School of Computer, National University of Defense Technology
7
Data Service
DRB: Data Request Broker
 Access

dispatch
System status and location of data
 Data
management
Uniform view：global logical view of data
resources
 Data replicating and moving

 Data

operation
Posix like APIs: create, open, read,
write, close, etc.
School of Computer, National University of Defense Technology
8
Data Service
Federated DRB Service

Distributed
service
Clinet(GUI)

Remote data access

Distributed data storage


collaborated
Collaborate management
Distributed
replica

cache
and
On-demand
access

High performance
transport
storage
and
DRB
server
DRB
Master
Cache
Management of cache and
copies

Cache
Remote DRB
server
access
between DEB
DRB Proxy
DRB Proxy
Storage
system
Cache
MDIS
MDIS
Storage
system
DRB
Master
Center
MDIS
Storage
system
Storage
system
data
School of Computer, National University of Defense Technology
9
Metadata Information Service

Global MDIS server




System information
Index information
…
Local MDIS server



GMDIS
LMDIS
LDMIS
Domain information
File information
…
Site A
Site B
School of Computer, National University of Defense Technology
Site C
10
Metadata Information Service

Metadata access and management





Uniform data namespace
Data locating, registration, and publishing
System information management
Data discovery
Replication
management



policy
and
Nearest replica access
Control of replica privileges
Management of replica lifetime
School of Computer, National University of Defense Technology
11
GridDaEn Security

GSI Compliance



Only use Proxy function of GSI
Separate GSI from Globus Toolkit
GridDaen Security Functionality：





Secure authentication
Communication encryption
Single sign on
Role-based authentication management
Multi-level user mapping
School of Computer, National University of Defense Technology
12
GridEye: Monitor System

up-level system
Based on GMA

Producer/consumer
model
Global domain
manager
GM
Web Service Interface
 Multi-layer structure



Local monitor--LM
Global monitor--GM
Local
domain 1
Local
domain 1
Local
domain 1
LM
LM
LM
…..
Sensor1
…..
Sensor1
…..
Sensor1
School of Computer, National University of Defense Technology
13
GridDaEn Tools
 User administrative
client
 User data operation client
 UIs



supported:
Graphic user interface
Command line
APIs and SDKs
School of Computer, National University of Defense Technology
14
GridDaEn v1.0 Features

Virtualized resources

Uniform operation and management

Coordination of autonomic system

High usability and security

Scalability

Multi-level authorization

Performance optimization
School of Computer, National University of Defense Technology
15
Our


Now available in our website

www.griddaen.org
www.datagrid.com.cn
GridDaEn v1.1



Works
GridDaEn v1.0


Future
web service Based
Available on 2005-1
GridDaEn v2.0 beta




Structured data and semi- structured data supported
 Related database ,XML database
More native file system and access protocol supported
Performance optimization
Available on 2005-4
School of Computer, National University of Defense Technology
16