Grid ASP Portals and the Grid PSE Builder
Satoshi Itoh
GTRC, AIST
3rd Oct. 2003
UK & Japan N+N Meeting
Takeshi Nishikawa
Naotaka Yamamoto
Hiroshi Takemiya
Motonori Hirano
Yoshio Tanaka
Satoshi Sekiguchi
2
Overview of Grid ASP
Grid ASP provides users PSE( Grid services )
Portal system hides Grid environment from users
User
Portal
GridASP
(Grid Service Provider)
PSE components
(Grid Services)
Main service is a batch job
UK & Japan N+N Meeting @ The Montague Hotel, London
•Application service
•Storage service
•Computing service
•DB service
:
3rd Oct. 2003
3
Activities @ GTRC, AIST
Software toolkit for constructing portal
Grid PSE Builder (GridLib)
Grid application portals
ISV software( Gaussian, Phoenics, ... )
user programming application
Experiment of Grid ASP (planning)
Feasibility study with real business players
UK & Japan N+N Meeting @ The Montague Hotel, London
3rd Oct. 2003
4
Overview of the Grid PSE Builder
Framework for building an application portal on a
grid environment
Globus Toolkit 2.x (MDS, GRAM, GSI)
UK & Japan N+N Meeting @ The Montague Hotel, London
3rd Oct. 2003
5
Single-sign-on/session manager
SSL client server mutual authentication
Session management at SSL/TSL layer
X.509 certificate based client authentication
Proxy certificate based on GSI using portal ID
( Single user account on grid environment )
UK & Japan N+N Meeting @ The Montague Hotel, London
3rd Oct. 2003
6
PSE Component information
Interface of application
XML-based Web page description language
Application name, location ...
Contents
Arguments (input parameters, ..)
Options
<application
xmlns="http://www.aist.go.jp/vcc"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://www.aist.go.jp/vcc application_schema.xml">
<appname>cat</appname>
<appid>1</appid>
<appcomment>Concatenate file(s).</appcomment>
<argspec>/bin/cat %option% %files%</argspec>
<arglist>
<args use="option" separate="true">
<title>Operation Option</title>
<checkbox name="option">
<box value="-b">number nonblank output lines</box>
<box value="-E">display $ at end of each line</box>
<box value="-n">number
all The
outputMontague
lines</box>Hotel, London
UK & Japan
N+N Meeting @
<b
l
" ">
th
i l bl k li </b >
3rd Oct. 2003
7
UK & Japan N+N Meeting @ The Montague Hotel, London
3rd Oct. 2003
8
Batch job / Data staging manager
In/Out file management for jobs
Upload and download input parameters and files between
client and Portal
Transfer files from portal server to specified resources
using GridFTP
Job execution management
Submit/ cancel jobs using globus GRM
Monitor status of jobs
UK & Japan N+N Meeting @ The Montague Hotel, London
3rd Oct. 2003
9
Future work for Grid PSE Builder
Individual accounting model
Proxy certificate for individual user
Users don’t need globus on their clients
Workflow control
User : describe workflow of their jobs
Provider : combine several applications as a
single service
UK & Japan N+N Meeting @ The Montague Hotel, London
3rd Oct. 2003
10
Grid Application portals
Phoenics Portal
Computational Fluid Dynamics
Weather forecast Portal
Meteorology
http://www.phoenics.co.jp/
QC Grid/ Gaussian Portal
Quantum Chemistry
UK & Japan N+N Meeting @ The Montague Hotel, London
3rd Oct. 2003
11
Phoenics Portal
PHOENICS is a commercial code for CFD.
Easy access to CFD application on parallel
supercomputer(SR8000)through TSUKUBA-WAN.
user
NTT-AS lab.
Phoenics Portal
10km
TSUKUBA-WAN
UK & Japan N+N Meeting @ The Montague Hotel, London
SR8000
AIST
3rd Oct. 2003
12
Weather forecast Grid portal
User programming application
A numerical weather prediction program
Prof. Tanaka (Univ. of Tsukuba).
3 Grid middlewares
Globus toolkit, Ninf-G, Grid PSE Builder
PC Cluster
Weather
Weatherforecast
forecastprogram
program
http
/ https
Grid
GridPSE
PSEBuilder
Builder
(GridLib)
(GridLib)
RPC
Ninf-G
Ninf-G
AIST
Globus
GlobusToolkit
Toolkit2.x
2.x
Web browser
KISTI
disturbance
Simulation
...
disturbance
Simulation
Statistics
Different
tens-hundreds
UK & Japan N+N Meeting @ Therandom
Montague Hotel, London
di
b
KU
3rd Oct. 2003
13
QC Grid/ Gaussian Portal
Purpose : Virtual laboratory for Quantum Chemistry
Target users : scientists and engineers in bio-chem,
bio-phys, material design, drug design, etc.
Special feature
Prediction of required resources
Avoidance of the same calculation
UK & Japan N+N Meeting @ The Montague Hotel, London
3rd Oct. 2003
14
Components of Gaussian Portal
Meta-scheduler
Web-based
user interface
Input flow
Input Analyzer
Estimator
Comparator
Retriever
Knowledge
DB
High-throughput
nodes
Large
Memory
nodes
output flow
Results
Meta-scheduler is a core
component of the Gaussian Portal DB
UK & Japan N+N Meeting @ The Montague Hotel, London
I/O archives
3rd Oct. 2003
15
Meta-scheduler
Input Analyzer
Evaluating the method for calculation, the number
of atoms, kind and number of basis set functions.
Estimator
Estimating the amount of computing resources (CPU
time, memory, disk space).
Comparator
comparing the computing time and the retrieval
time, and judging whether to retrieve or to
compute.
Retriever
Retrieving previous results.
UK & Japan N+N Meeting @ The Montague Hotel, London
3rd Oct. 2003
16
Grid ASP Experiment
Feasibility study on business models
Real business players contribute the experiment by
their own ways.
Period : Oct. 2003 – March 2006
Users: companies, laboratories, consumers
Portal: Portal company
Management
Applications : ISV vender, ...
Middleware : SIer
Computer, Storage : H/W vender, ...
Network : Carrier, ...
UK & Japan N+N Meeting @ The Montague Hotel, London
3rd Oct. 2003
17
Players in Grid ASP business
Some of functions may be acted by one player.
User company
Result
data
リソースプロバイダ
Resource provider
Gaussian
Phoenics
....
User
Design
data
ASP
ASP
Portal
User
management
Computer
resources
License
management
Server
Applications
Storage
Provider
management.
Data
management
UK & Japan N+N Meeting @ The Montague Hotel, London
3rd Oct. 2003